-- Logs begin at Fri 2022-05-27 02:23:32 UTC, end at Fri 2022-05-27 03:46:23 UTC. -- May 27 03:08:25.269373 dv-cinder-828807-4-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 03:08:25.277920 dv-cinder-828807-4-smb devstack@keystone.service[80281]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:08:25 2022] *** May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: nodename: dv-cinder-828807-4-smb May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: machine: x86_64 May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: clock source: unix May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: pcre jit disabled May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: detected number of CPU cores: 4 May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: current working directory: / May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: detected binary path: /usr/bin/uwsgi-core May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: your processes number limit is 47680 May 27 03:08:25.279974 dv-cinder-828807-4-smb devstack@keystone.service[80281]: your memory page size is 4096 bytes May 27 03:08:25.280643 dv-cinder-828807-4-smb devstack@keystone.service[80281]: detected max file descriptor number: 2048 May 27 03:08:25.280643 dv-cinder-828807-4-smb devstack@keystone.service[80281]: lock engine: pthread robust mutexes May 27 03:08:25.280643 dv-cinder-828807-4-smb devstack@keystone.service[80281]: thunder lock: enabled May 27 03:08:25.280643 dv-cinder-828807-4-smb devstack@keystone.service[80281]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 03:08:25.280643 dv-cinder-828807-4-smb devstack@keystone.service[80281]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:08:25.325788 dv-cinder-828807-4-smb devstack@keystone.service[80281]: Python main interpreter initialized at 0x56085d77a9c0 May 27 03:08:25.325788 dv-cinder-828807-4-smb devstack@keystone.service[80281]: python threads support enabled May 27 03:08:25.325788 dv-cinder-828807-4-smb devstack@keystone.service[80281]: your server socket listen backlog is limited to 100 connections May 27 03:08:25.325788 dv-cinder-828807-4-smb devstack@keystone.service[80281]: your mercy for graceful operations on workers is 90 seconds May 27 03:08:25.326185 dv-cinder-828807-4-smb devstack@keystone.service[80281]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:08:25.326262 dv-cinder-828807-4-smb devstack@keystone.service[80281]: *** Operational MODE: preforking *** May 27 03:08:25.326525 dv-cinder-828807-4-smb devstack@keystone.service[80281]: *** uWSGI is running in multiple interpreter mode *** May 27 03:08:25.326525 dv-cinder-828807-4-smb devstack@keystone.service[80281]: spawned uWSGI master process (pid: 80281) May 27 03:08:25.326731 dv-cinder-828807-4-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 03:08:25.327395 dv-cinder-828807-4-smb devstack@keystone.service[80281]: spawned uWSGI worker 1 (pid: 80289, cores: 1) May 27 03:08:25.330016 dv-cinder-828807-4-smb devstack@keystone.service[80281]: spawned uWSGI worker 2 (pid: 80290, cores: 1) May 27 03:08:25.330016 dv-cinder-828807-4-smb devstack@keystone.service[80281]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:08:30.967224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:08:30.967224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: from cryptography.utils import int_from_bytes May 27 03:08:30.968006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:08:30.968006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: from cryptography.utils import int_from_bytes May 27 03:08:30.980145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:08:30.980145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes May 27 03:08:30.980686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:08:30.980686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes May 27 03:08:31.024510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:08:31.024706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:08:31.024873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] command line args: [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:08:31.025141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:08:31.025320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ================================================================================ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:08:31.025576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] admin_token = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.025819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config_dir = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.026031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.026216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] config_source = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.026448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] debug = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.026663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.027159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.027252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.027455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.027707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.027858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:08:31.027947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.028050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:08:31.028125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_config_append = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.028242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] command line args: [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:08:31.028353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.028465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_dir = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.028570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:08:31.028672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.028767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ================================================================================ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:08:31.028889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config_dir = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] config_source = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] debug = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.029920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.030964 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_config_append = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.031784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_dir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.032908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] publish_errors = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.033944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] standard_threads = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.034899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_journal = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_json = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_stderr = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] use_syslog = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.035988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.036102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.036223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] publish_errors = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.036337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.036519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.036637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.036756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.036756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.036986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.037107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.037221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.037332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.037444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.037564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] standard_threads = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.037677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.037790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.037902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.038029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.038143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.038271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.038386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.038499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_journal = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.038499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_json = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.038706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.038824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_stderr = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.038948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.039068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] use_syslog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.039182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.039294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:08:31.039406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.039597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.039714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.039827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.039940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.040968 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.041903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.042899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.043990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.044912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.045914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.046971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.047900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.048945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.049869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.050998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.051886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.052936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.053946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.054895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.055931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.056928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.057044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.057165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.057280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.057393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.057513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.057633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.058308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.058424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.058538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.058650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.058769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.058889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.059945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.060988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.external = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.061906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.password = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.062964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.token = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.063938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.external = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.064996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.password = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.token = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.065941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.066909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.067964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.068979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.069922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.070983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.071917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.072979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.073102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.073219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.073367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.074891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.075979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.076999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.077931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.078983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.079920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.080889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.081924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.082891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.083933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.084901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.085947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.086976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.087923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.088966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.089905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.090962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.091901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.092931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.093859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.094903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.095947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.096323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.096450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.096567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.096682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.096797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.096912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.097855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.098944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.099987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.100894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.101934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.102890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.103940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.104993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.105925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.106924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.107988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.108931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.109998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.110937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.111888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112244 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.112476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.113482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.113482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.113482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.113482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:08:31.113482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:08:31.145371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.145581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.145804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.148655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.148891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.149120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.155908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.157847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.186130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.186358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.188210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.188447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.240440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.241173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.291293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.291516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.294235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.294235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.357591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.357788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.357882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.358906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.382967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.383867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.394708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.394868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.407297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.407529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.407671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.407753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.407828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.407958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.408812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:08:31.426771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.426905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.426985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:08:31.427055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:08:31.427305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.427390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.427506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:08:31.427590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:08:31.427775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.427859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.428037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.428122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.428285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.428367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.428533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.428625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.440276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.440553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.440819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.441101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.441820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.442116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.442380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.442655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.449367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.450879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.452780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.453063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.453349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.453630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.453910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.454187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.454467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.454584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.454745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.454863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.455948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.456099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.456214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.456424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.456696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.456963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.484143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.484715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.485854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.486149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.486379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.486777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.491462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.491687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.491969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.492285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.492569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.492851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.499811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.500087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.500827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.501113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.504558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.504956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.505234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.505513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.505633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.505785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.505917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.506080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.506223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.506345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.506506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.506614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.506895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.507173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.507448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.507720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.525200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.525481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.527109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.527390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.530688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.532122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.534349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.534637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.535814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.536113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.539635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.541215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.543817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.545490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.547574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.547868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.548156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.548435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.548710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.548990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.549171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.549471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.549764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.550206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.550501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.550794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.567903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.568182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.568444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.568700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.569913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.570222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.570491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.570755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.576716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.578436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.578726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.578873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.580601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.580877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.581742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.582051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.582330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.582604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.582879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.583967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.584245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.584538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.584824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.585103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.596991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.597264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.597539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.597821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.598122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.598401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.598670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.599492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.599774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.600063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.600345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.600627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.600901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.601185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.617222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.619800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.620514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.623291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.623847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.625449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.626638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.627089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.627369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.627653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.628262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.629907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.630222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.630504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.635065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.636733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.637983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.639626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.639988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.640275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.640557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.640835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.642930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.643233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.643519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.643798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.649878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.650186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.650564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.653529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.653817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.654126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.658954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.659231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.659505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.659773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.660048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.660317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.660584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.660860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.661121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.661388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.661652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.661913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.662194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.662278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:08:31.662455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.662588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.662743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.663020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.663293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.663566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.663855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.664125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.664401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.664669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.664989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.665206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.665477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.665741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:08:31.701453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56085d77a9c0 pid: 80290 (default app) May 27 03:08:31.704742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56e5a-e65c-4aa5-ba5b-433716d2eb8e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:31.705035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56e5a-e65c-4aa5-ba5b-433716d2eb8e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:31.705306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56e5a-e65c-4aa5-ba5b-433716d2eb8e None None] PATH_INFO: `/v3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:31.705407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56085d77a9c0 pid: 80289 (default app) May 27 03:08:31.709589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Fri May 27 03:08:31 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:39.743003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:39.743540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:39.743540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:39.748744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:08:39.754839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:39.755321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:39.755413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:39.831703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: INFO dbcounter [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] Registered counter for database keystone May 27 03:08:39.853658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:08:39.859938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writer thread running {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:08:40.038163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80290) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 03:08:40.038511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80290) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 03:08:40.094992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:40.096871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:40.223177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 03:08:40.387780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:40.457114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: INFO dbcounter [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] Registered counter for database keystone May 27 03:08:40.477218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG oslo_db.sqlalchemy.engines [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:08:40.483501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writer thread running {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:08:40.603312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d05e64-d43d-4216-b3fe-72e1778670c8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:40.607609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:40.608271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:40.608556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:40.608831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:40.617097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:40.668594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 03:08:40.668868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abd00-4475-4cc1-8474-06874e7b4a6a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:40.679360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Fri May 27 03:08:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 03:08:40.686156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:40.701285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9edd42-c196-434e-a685-fc56c362185f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:40.705750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:40.706914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:40.707201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:40.707475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] PATH_INFO: `/v3/projects/3b90443493d84a01a8c521f600d4b6fc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:40.708980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b90443493d84a01a8c521f600d4b6fc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:40.761875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING keystone.common.rbac_enforcer.enforcer [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 03:08:40.762523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7ce72-d893-428b-9074-6d18be7e1151 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:40.766885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Fri May 27 03:08:40 2022] GET /identity/v3/projects/3b90443493d84a01a8c521f600d4b6fc => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:42.987328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518887-de60-4f29-a0af-8afafba19b31 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:42.987946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518887-de60-4f29-a0af-8afafba19b31 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:42.987946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518887-de60-4f29-a0af-8afafba19b31 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:42.992434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:08:42.999869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:43.000805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:43.000805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:43.026573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:43.028169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:43.036847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 03:08:43.063092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518887-de60-4f29-a0af-8afafba19b31 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:43.080091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518887-de60-4f29-a0af-8afafba19b31 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:43.085282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcee174-790b-415f-911d-9e69100b9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:43.086160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee174-790b-415f-911d-9e69100b9d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:43.086449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee174-790b-415f-911d-9e69100b9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:43.086729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee174-790b-415f-911d-9e69100b9d68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:43.098689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcee174-790b-415f-911d-9e69100b9d68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:43.101337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcee174-790b-415f-911d-9e69100b9d68 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:43.111845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Fri May 27 03:08:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:08:43.118211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:43.128312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e8b9-f0f7-4f5c-a833-50829664caf9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:43.133132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f279d1-5a44-4c59-9c11-0785e8a1c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:43.134029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f279d1-5a44-4c59-9c11-0785e8a1c6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:43.134321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f279d1-5a44-4c59-9c11-0785e8a1c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:43.134595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f279d1-5a44-4c59-9c11-0785e8a1c6f8 admin admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:43.136719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f279d1-5a44-4c59-9c11-0785e8a1c6f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:43.138704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f279d1-5a44-4c59-9c11-0785e8a1c6f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:43.140333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Fri May 27 03:08:43 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:45.537260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2f05-443f-43df-bcd8-9fcb09faea3f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:45.537770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2f05-443f-43df-bcd8-9fcb09faea3f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:45.537870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f2f05-443f-43df-bcd8-9fcb09faea3f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:45.539211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:45.544913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:45.545387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:45.545477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:45.558594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0c69-e171-418b-b107-7a87b4b11739 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:45.558881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0c69-e171-418b-b107-7a87b4b11739 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:45.559158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0c69-e171-418b-b107-7a87b4b11739 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:45.560518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:08:45.562951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:45.564151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:45.565932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:45.566248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:45.566527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:45.607175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG passlib.handlers.bcrypt [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80289) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 03:08:45.607604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG passlib.handlers.bcrypt [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80289) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 03:08:45.644329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:45.654963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:45.656565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:45.667674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:45.691119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:45.758191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:08:45.779345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd13e3-d72b-47e4-a773-bd0a85544fcc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:45.785268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:45.814392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:45.815185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:45.815476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:45.815750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:45.827750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:08:45.839302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:08:45.840611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:08:45.841479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:08:45.847071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:46.003199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a19f57-8bdb-48d1-999a-aae044c1f657 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.005757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:46.043946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.044768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.045057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.045336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.046099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:46.065590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec157b-6ff7-4a5f-80c7-51de826a6b85 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.102972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.103648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.103993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.104801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.105560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:46.105863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.107325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.118570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.120159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.120283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:46.126834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:46.220419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:08:46.226534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:46.228141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aac4ad-31dc-4d55-8496-c976a8d91f9a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.230188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:46.265437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.266356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.266642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.266918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.268153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.269630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.271495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:08:46 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:08:46.276762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:46.291935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:46.327915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcff4e0-3e21-419a-b226-d2897cc3487d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.361754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.362580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.362862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.363136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.379032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60fa3-12c6-4480-a898-c6b656362c89 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.382395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.383918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:08:46.404222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:08:46.405099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:08:46.405898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:08:46.405898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:08:46.405898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:08:46.405898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:08:46.405898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:08:46.411362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:46.412779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.413619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.414164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.414666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.417042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.418558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.420234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:08:46.427239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:46.479534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:46.511641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:46.525431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b59e0-60b5-4b63-ab0e-d101edb39970 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.531767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cf418-5375-40f2-ab05-96934c03b27d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:46.560482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.561152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.561433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.561704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.562590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:46.562835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.564235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17c541-1162-4f8a-a9c7-b9bdfac59eea None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.565846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:46.566536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:46.566822 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:46.567099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:46.567943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.domain.id=default, user.id=a29912cd78134fb2b757b551f0545235) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:46.568262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:46.569720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26c1f5-d4c4-453f-8c2e-1649a1ca4f8f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:46.577104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Fri May 27 03:08:46 2022] GET /identity/v3/role_assignments?user.id=a29912cd78134fb2b757b551f0545235&scope.domain.id=default&role.id=d0122fde930842079d42ce76139767e2 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:08:46.582071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:08:49.246264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4188-7465-4f58-8388-f724b1f17ea6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.247111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4188-7465-4f58-8388-f724b1f17ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.247455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4188-7465-4f58-8388-f724b1f17ea6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.249214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:49.267115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2e91-adcb-43b2-8802-d38fc094097d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.268054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2e91-adcb-43b2-8802-d38fc094097d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.268620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2e91-adcb-43b2-8802-d38fc094097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.296193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f25f2e91-adcb-43b2-8802-d38fc094097d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:49.297982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f25f2e91-adcb-43b2-8802-d38fc094097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:49.407610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:49.443233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b4188-7465-4f58-8388-f724b1f17ea6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:49.623688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b4188-7465-4f58-8388-f724b1f17ea6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:49.679256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:49.680063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.680342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.680615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.699002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:08:49.706823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:08:49.707724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:08:49.708515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 13/24] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:08:49.715032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:49.715913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829f84e-7431-46df-b1aa-12b8d6fd1622 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.716413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829f84e-7431-46df-b1aa-12b8d6fd1622 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.716892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829f84e-7431-46df-b1aa-12b8d6fd1622 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.718537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 12/25] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:49.722339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:49.724378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ddd47-60b1-4374-8b60-5c4c192fbc5d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.724945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ddd47-60b1-4374-8b60-5c4c192fbc5d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.725427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ddd47-60b1-4374-8b60-5c4c192fbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.753083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-586ddd47-60b1-4374-8b60-5c4c192fbc5d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:49.754704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-586ddd47-60b1-4374-8b60-5c4c192fbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:49.850148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:49.898962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a5ac9-8dca-4532-868e-8c540c23ab40 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:49.914140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 13/26] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:08:49.915522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da559f84-e0c9-4c8f-936f-74328aefbe1a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.915812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da559f84-e0c9-4c8f-936f-74328aefbe1a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.916084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da559f84-e0c9-4c8f-936f-74328aefbe1a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.918248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 14/27] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:49.925766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.926305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.926588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.958837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:49.960057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:49.978705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:49.980052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:49.980336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:49.980609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:49.981419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:49.981727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:49.984137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.000921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 14/28] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:50.002646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.091544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 15/29] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:50.092401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.128285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:50.189802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570562e-e8d3-4ddc-a65a-381954b5e4e5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.241904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5070f64-fd6d-4a88-8812-d842f6ba3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.243070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070f64-fd6d-4a88-8812-d842f6ba3dbe None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.243569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070f64-fd6d-4a88-8812-d842f6ba3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.244057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070f64-fd6d-4a88-8812-d842f6ba3dbe None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.245633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5070f64-fd6d-4a88-8812-d842f6ba3dbe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.247457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5070f64-fd6d-4a88-8812-d842f6ba3dbe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.249808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36348a1-48ad-4f71-9164-7028ad9af2c9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.259709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:50.295988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.297672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.298190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.298676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.300619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.302309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.304650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 16/30] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:08:50 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:50.305621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.378675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 15/31] 10.222.0.61 () {60 vars in 1131 bytes} [Fri May 27 03:08:50 2022] POST /identity/v3/roles => generated 219 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:08:50.380238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3676ae-fc05-4c6c-bcee-57d615b7e148 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.380534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3676ae-fc05-4c6c-bcee-57d615b7e148 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.380869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3676ae-fc05-4c6c-bcee-57d615b7e148 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.382263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 16/32] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:50.383007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3676ae-fc05-4c6c-bcee-57d615b7e148 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.431009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7977b2-b25d-41cd-af79-79248fe854e7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.481531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.484536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.486306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.486822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.514006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.517488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8cba0cd4-f8b0-467f-9297-6c73a6fcf527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:08:50.555132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:08:50.556047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:08:50.556931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:08:50.556931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:08:50.556931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:08:50.556931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:08:50.559087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 17/33] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:08:50.560803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.561325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.561827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.586819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:50.588944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:50.594777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3676ae-fc05-4c6c-bcee-57d615b7e148 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.613116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:50.629984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:50.642153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.643444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.643926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.644360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.647136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.649155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.651840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 17/34] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:50.652936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.691649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 18/35] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:50.693289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.770143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f378a-b7b0-46ca-8571-cc48c282f58c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.808168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.808867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.809155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.809433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.810221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:50.810519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc13db1-0a5b-472b-beff-45ca105699f1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.810616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.811976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.833200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 18/36] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:50.834060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.852760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e55e2-353c-48f7-9a3d-6c2c655cb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.853638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e55e2-353c-48f7-9a3d-6c2c655cb376 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.854555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e55e2-353c-48f7-9a3d-6c2c655cb376 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.854831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e55e2-353c-48f7-9a3d-6c2c655cb376 None admin] PATH_INFO: `/v3/domains/default/users/a29912cd78134fb2b757b551f0545235/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.856826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e55e2-353c-48f7-9a3d-6c2c655cb376 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a29912cd78134fb2b757b551f0545235, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.858344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e55e2-353c-48f7-9a3d-6c2c655cb376 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.892237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:50.936581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be444-69c6-4bb8-b066-bde585620099 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:50.970404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62e38-016f-40e3-96ab-9340fd902208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:50.971445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62e38-016f-40e3-96ab-9340fd902208 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.971754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62e38-016f-40e3-96ab-9340fd902208 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.972038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62e38-016f-40e3-96ab-9340fd902208 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.972265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 19/37] 10.222.0.61 () {58 vars in 1361 bytes} [Fri May 27 03:08:50 2022] PUT /identity/v3/domains/default/users/a29912cd78134fb2b757b551f0545235/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:08:50.973228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62e38-016f-40e3-96ab-9340fd902208 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:50.974332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032550-e33f-4d17-9b50-0050e4e30f89 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.974628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032550-e33f-4d17-9b50-0050e4e30f89 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.974719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62e38-016f-40e3-96ab-9340fd902208 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:50.974909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032550-e33f-4d17-9b50-0050e4e30f89 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.979854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 20/38] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:50.981290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa463-320d-4f7c-9fa9-29a0c6b5dd75 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:50.981591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa463-320d-4f7c-9fa9-29a0c6b5dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:50.981883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aa463-320d-4f7c-9fa9-29a0c6b5dd75 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:50.983492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 21/39] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:50.984154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49aa463-320d-4f7c-9fa9-29a0c6b5dd75 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:50.998859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 19/40] 10.222.0.61 () {60 vars in 1131 bytes} [Fri May 27 03:08:50 2022] POST /identity/v3/roles => generated 225 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:08:51.000673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7319e-753e-42b1-9bae-4517da342316 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:51.001042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7319e-753e-42b1-9bae-4517da342316 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:51.001491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7319e-753e-42b1-9bae-4517da342316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:51.025573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-52a7319e-753e-42b1-9bae-4517da342316 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:51.027724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52a7319e-753e-42b1-9bae-4517da342316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:51.029836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:51.123672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 20/41] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:51.131755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:51.132111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:51.132470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:51.169072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:51.170655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:51.172372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49aa463-320d-4f7c-9fa9-29a0c6b5dd75 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:51.224455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:51.225144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:51.225429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:51.225632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:51.225733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:51.226552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:51.228197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:51.272683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:08:50 2022] POST /identity/v3/projects => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:08:51.273572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 21/43] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:51.274055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:51.300287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:51.375105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:51.424518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607d04c-1c6d-46a9-a1a2-6a52b980d046 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:51.431694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81382b-67bb-4ba1-8cff-4f8574269c6a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:51.465338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e168cb-a629-4d31-bede-d36f4e0adc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:51.466549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e168cb-a629-4d31-bede-d36f4e0adc1f None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:51.466844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e168cb-a629-4d31-bede-d36f4e0adc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:51.467407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e168cb-a629-4d31-bede-d36f4e0adc1f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:51.468191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e168cb-a629-4d31-bede-d36f4e0adc1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:51.470579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e168cb-a629-4d31-bede-d36f4e0adc1f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:51.479827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:51.480947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:51.481410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:51.481925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:51.483452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:51.485808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:51.498203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 22/45] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:51.498203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:51.498433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 23/45] 10.222.0.61 () {60 vars in 1131 bytes} [Fri May 27 03:08:51 2022] POST /identity/v3/roles => generated 223 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:08:51.561306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:51.631855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859eca-3ebf-4efe-8c0d-9a552631b98d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:51.669278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b648b2-8320-49c8-9976-ef3c9e658d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:51.669986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b648b2-8320-49c8-9976-ef3c9e658d5d None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:51.670286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b648b2-8320-49c8-9976-ef3c9e658d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:51.670554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b648b2-8320-49c8-9976-ef3c9e658d5d None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:51.671288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b648b2-8320-49c8-9976-ef3c9e658d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:51.672770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b648b2-8320-49c8-9976-ef3c9e658d5d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:51.703482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:08:51 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:08:53.274862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104bf7d-c935-4a97-bb3d-02c987b4f8cf None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.275387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104bf7d-c935-4a97-bb3d-02c987b4f8cf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.276012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104bf7d-c935-4a97-bb3d-02c987b4f8cf None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.277306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 24/47] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:53.282829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.283288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.283385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.300727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:53.301939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:53.373937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 24/48] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:53.396874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104bf7d-c935-4a97-bb3d-02c987b4f8cf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:53.500918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104bf7d-c935-4a97-bb3d-02c987b4f8cf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:53.528488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:53.537488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:53.538328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.538616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.538892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.551360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:08:53.560343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:08:53.561204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:08:53.562006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 25/49] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:08:53.567451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:53.592574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:53.669199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb38b0-fdfb-4433-8e49-eb986849531a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:53.702654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:53.703356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.703640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.703914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.704662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:53.704968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:53.706399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:53.715406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 25/50] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:08:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:53.721284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:53.825421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280632af-98b5-48ce-b075-ddd516c11349 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:53.858908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61435b-37e5-4ce8-8d1f-ff981138add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:53.859789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61435b-37e5-4ce8-8d1f-ff981138add6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.860073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61435b-37e5-4ce8-8d1f-ff981138add6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.860350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61435b-37e5-4ce8-8d1f-ff981138add6 None admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.861571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61435b-37e5-4ce8-8d1f-ff981138add6 None admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:53.863094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61435b-37e5-4ce8-8d1f-ff981138add6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:53.864738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 26/51] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:08:53 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:53.870048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:53.930866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34584-0b65-4220-81e5-4b26bcae92c3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.931159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34584-0b65-4220-81e5-4b26bcae92c3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.931444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34584-0b65-4220-81e5-4b26bcae92c3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.932825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 27/52] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:08:53.937848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:53.938169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:53.938457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:53.955399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:53.955823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:53.957494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:53.972018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399b9a4-0e40-4a61-b113-2417d33c0106 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:54.010579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:54.011391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:54.011785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:54.012105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:54.013449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:54.015057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:54.016769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:54.017035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:54.023712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:54.036517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 28/54] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:08:54.060528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:54.129851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a48a-1f4d-4c6a-a73e-f4b12abdb90f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:54.163671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:54.164319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:54.164413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf925-113d-44ef-b309-1c38a7dfc075 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:54.164603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:54.164876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:54.165697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.domain.id=default, user.id=a29912cd78134fb2b757b551f0545235) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:08:54.166033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:54.167521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:54.173744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1322 bytes} [Fri May 27 03:08:54 2022] GET /identity/v3/role_assignments?user.id=a29912cd78134fb2b757b551f0545235&scope.domain.id=default&role.id=d0122fde930842079d42ce76139767e2 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:08:54.202560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0837df-2cd9-40cd-9097-9dffcbd05951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:54.203423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0837df-2cd9-40cd-9097-9dffcbd05951 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:54.203713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0837df-2cd9-40cd-9097-9dffcbd05951 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:54.203995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0837df-2cd9-40cd-9097-9dffcbd05951 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:54.205283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0837df-2cd9-40cd-9097-9dffcbd05951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:54.206838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0837df-2cd9-40cd-9097-9dffcbd05951 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:54.208577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 29/56] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:08:54.214461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:54.235120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:54.324788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f6b83-028f-45ef-8cba-3eceb3e504a7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:54.363952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46e8c-506e-4584-a270-4dfb374b1dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:54.364636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46e8c-506e-4584-a270-4dfb374b1dcb None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:54.364925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46e8c-506e-4584-a270-4dfb374b1dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:54.365204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46e8c-506e-4584-a270-4dfb374b1dcb None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:54.365941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46e8c-506e-4584-a270-4dfb374b1dcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:54.368011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46e8c-506e-4584-a270-4dfb374b1dcb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:54.397680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 28/57] 10.222.0.61 () {60 vars in 1140 bytes} [Fri May 27 03:08:54 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:08:56.648822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80c7f3-0648-4028-b0bf-039b2779b24c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:56.649366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80c7f3-0648-4028-b0bf-039b2779b24c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:56.649366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80c7f3-0648-4028-b0bf-039b2779b24c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:56.651312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 30/58] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:08:56.656410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:56.656819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:56.656977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:56.673889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:08:56.675104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:08:56.734898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:56.740109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 29/59] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:08:56.763632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80c7f3-0648-4028-b0bf-039b2779b24c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:56.818753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:08:56.868270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80c7f3-0648-4028-b0bf-039b2779b24c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:56.902730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c93ee-e17c-4db1-9a79-538e16d4665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:56.903533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c93ee-e17c-4db1-9a79-538e16d4665e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:56.903821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c93ee-e17c-4db1-9a79-538e16d4665e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:56.904101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c93ee-e17c-4db1-9a79-538e16d4665e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:56.905297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c93ee-e17c-4db1-9a79-538e16d4665e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:56.906788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c93ee-e17c-4db1-9a79-538e16d4665e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:56.908423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 31/60] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:08:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:08:56.914038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:08:57.011192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5435-0255-4d52-8cbb-509d7601227d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:08:57.044849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8061-5632-476b-b602-d2504d3aa3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:08:57.045446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8061-5632-476b-b602-d2504d3aa3d2 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:08:57.045728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8061-5632-476b-b602-d2504d3aa3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:08:57.046028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8061-5632-476b-b602-d2504d3aa3d2 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:08:57.046756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c8061-5632-476b-b602-d2504d3aa3d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:08:57.048208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c8061-5632-476b-b602-d2504d3aa3d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:08:57.073027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 30/61] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:08:56 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:00.520663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253142a-6155-4201-917f-d18a4c328165 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.521700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253142a-6155-4201-917f-d18a4c328165 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.522265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253142a-6155-4201-917f-d18a4c328165 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.524421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 32/62] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:00.530275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3bcac-0893-439e-a27b-73bb5fe517b8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.531299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3bcac-0893-439e-a27b-73bb5fe517b8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.531786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3bcac-0893-439e-a27b-73bb5fe517b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.558741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3ed3bcac-0893-439e-a27b-73bb5fe517b8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:00.560285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3ed3bcac-0893-439e-a27b-73bb5fe517b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:00.641587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:00.667135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:00.705290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253142a-6155-4201-917f-d18a4c328165 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:00.718315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b86a-e9a8-4a6e-acfa-0cab06b5592b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.718603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b86a-e9a8-4a6e-acfa-0cab06b5592b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.718889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b86a-e9a8-4a6e-acfa-0cab06b5592b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.720480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 32/64] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:00.725485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188339-8efe-4786-b1b7-ad0f7b294ddd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.725775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188339-8efe-4786-b1b7-ad0f7b294ddd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.726089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188339-8efe-4786-b1b7-ad0f7b294ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.752153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-07188339-8efe-4786-b1b7-ad0f7b294ddd None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:00.753263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-07188339-8efe-4786-b1b7-ad0f7b294ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:00.844314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253142a-6155-4201-917f-d18a4c328165 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:00.851092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 33/65] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:00.852779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1e08-ef07-44a0-a3cd-e238a370a995 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.853367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1e08-ef07-44a0-a3cd-e238a370a995 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.854088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1e08-ef07-44a0-a3cd-e238a370a995 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.855636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 34/66] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:00.857150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede83460-927f-4497-9d2c-db26c134130b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.857687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede83460-927f-4497-9d2c-db26c134130b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.858205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede83460-927f-4497-9d2c-db26c134130b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.859695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 35/67] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:00.861140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7190c-230f-455b-9c29-815814f2e134 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.861730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7190c-230f-455b-9c29-815814f2e134 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.862239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7190c-230f-455b-9c29-815814f2e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.877039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:00.884487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ada7190c-230f-455b-9c29-815814f2e134 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:00.886669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ada7190c-230f-455b-9c29-815814f2e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:00.892037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:00.892862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.893142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.893415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.906580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:00.917536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:00.918748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:00.919538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 33/68] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:00.920165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:00.964938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 36/69] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:00.967580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:00.967875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:00.968156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:00.991007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:00.992844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:01.033185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f1ea3-0d3e-4857-9f34-531a11bf07e3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.040650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.067197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 37/70] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:01.068057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.079775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.080588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.080869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.081141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.094509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:01.102618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:01.103624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:01.104411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 34/71] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:01.105049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.148212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.180190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efad21-28ff-4752-9aff-7bfd8772aa21 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.209912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108cb1-8560-433c-9d0f-1f0be932af4b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.214572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.215241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.215523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.215797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.216541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:01.216846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.218323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdc02-f572-4928-9db7-145571a004a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.227415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 38/72] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.232794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8bbf9-73f5-40b7-855d-df21677f8867 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.233085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8bbf9-73f5-40b7-855d-df21677f8867 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.233363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8bbf9-73f5-40b7-855d-df21677f8867 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.234743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 39/73] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:01.236755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8bbf9-73f5-40b7-855d-df21677f8867 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.249145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.249953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.250274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.250559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.264868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:01.273849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:01.276463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 35/74] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:01.277415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.280714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.343504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8bbf9-73f5-40b7-855d-df21677f8867 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.376663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.377469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.377754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.378055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.388932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:01.389408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbd1d6-f5ea-4595-a7cc-5a1ca0121a65 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.391121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:01.397257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:01.398143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:01.398951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 40/75] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:01.400082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.426584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.427269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.427560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.427845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.428604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:01.428914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.430340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513091f-feb1-4821-ab54-8eb7eaf3b3f2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.441782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 36/76] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.443054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.443348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.443632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.460305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:01.461531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:01.506514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.512435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1e90-d6d7-4ed3-a0bc-85d6ca9b4906 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.532302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 37/77] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:01.534897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.548803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.549680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.549979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.550256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.564616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.566123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.567861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 41/78] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.567861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.636793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.644560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea8747-21ef-4bea-bb39-38d634be5f1b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.670138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e714dd-d47b-4b7b-bb30-1cc7c303a259 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.677815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.678537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.678820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.679092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.679834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:01.680137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.682108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.690260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 38/79] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.691055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.709571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.710279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.710560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.710835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.711571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:01.711875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.713811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.722139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 42/80] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.722946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.743994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.790866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575b7d-a530-47e6-b2d3-75f4866a11cc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.824095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.824963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.825087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c635-c81e-439a-b0b7-bae2ce68b761 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.825243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.825512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.826732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.828182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.829804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 39/81] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.830589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.857500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.859877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.860702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.861004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.861261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:01.862489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:01.863934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:01.865553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 43/82] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:01.866333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:01.941689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dfc5f-f113-4d85-8e43-ad8e0695badd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.954266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:01.970109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b4dd-2a62-4c76-b89f-0e059932b5f1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:01.983425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:01.984081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:01.984363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:01.984635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.004115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.005010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.005293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.005566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.006927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.008412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.010932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 44/83] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:02.011545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.063250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.064745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.089317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.113833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc1e13-32d1-4086-bb2d-055441a7f868 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:02.147630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.148503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.148788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.149063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.150877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.152327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.153981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 45/84] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:02.154760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.167527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 40/85] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:02.168314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.180751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.256757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d414aa-d7f9-4724-a482-ad8f09da689c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:02.269594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffa857-e113-4c48-a152-42c6dc02ab51 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:02.292474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.293148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.293438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.293714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.293797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.304831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.305501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.305790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.306103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.307325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.308784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.334546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 41/86] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:02 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:02.335221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.372590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.374151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.402320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.450712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f946943-c690-4a39-8a23-51e25c68ccb4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:02.489577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.490297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.490585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.490862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.498000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 46/87] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:02.499304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.558913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.591329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.593330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.626962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b09ae-4d13-4b3e-82ed-1edc0bb6e874 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:02.658726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.671448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.672251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.672633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.673008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.733511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 42/88] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:02.734468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.769419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.771800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.833300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:02.857169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4ca5e-a6ce-4d1a-bc23-317f6a628646 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:02.895387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:02.896283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:02.896567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:02.896840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:02.898167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:02.899676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:02.901728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 43/89] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:02.907636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.913339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 47/90] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:02.919907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:02.952591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:03.031716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66744-65d5-487a-a27c-be413b2e1697 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.049728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c82e-da51-4a92-a62d-87bf52864dee None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.067469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.068403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.068684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.069000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.070344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.072017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.073821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 44/91] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:03.074748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:03.094028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.095914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.096415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.096887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] PATH_INFO: `/v3/projects/b5945fe33b684830a6360ec0f1a70097` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.098899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] RBAC: Authorizing `identity:get_project(project_id=b5945fe33b684830a6360ec0f1a70097)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.101309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.104593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 48/92] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:02 2022] GET /identity/v3/projects/b5945fe33b684830a6360ec0f1a70097 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:03.105918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:03.122325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:03.196241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bca99-e067-4908-9c45-908d1d88c0a6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.214391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:03.218246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ff87f-8c70-4d20-af9c-8b731ab5e362 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.244026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.244983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.245406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.245888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.247412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=0ba528083e754b4f8ef5b418a22cc985) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:03.247875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.250025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.260183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 45/93] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:03 2022] GET /identity/v3/role_assignments?user.id=0ba528083e754b4f8ef5b418a22cc985&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=ee525f9120064af5a37358b119bbedae => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:03.262204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:03.269723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.273210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.274792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.275864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.283083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.284878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.288953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 49/94] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:03 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:03.292845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:03.433463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:03.460156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5566e5-8b8b-4949-89fe-f491b1d508f5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.469091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6864dac-48dc-4752-a7f0-9aa06b324e13 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.526265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.526939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.527223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.527515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.528342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=a29912cd78134fb2b757b551f0545235) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:03.528654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.530155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.534462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.535131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.535410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.535686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.536518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=b5945fe33b684830a6360ec0f1a70097, user.id=0ba528083e754b4f8ef5b418a22cc985) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:03.536827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.537178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 46/95] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:03 2022] GET /identity/v3/role_assignments?user.id=a29912cd78134fb2b757b551f0545235&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:03.538140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:03.538891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299949e-0dc4-4a77-9245-b184dbb8c93f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.547170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 50/96] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:03 2022] GET /identity/v3/role_assignments?user.id=0ba528083e754b4f8ef5b418a22cc985&scope.project.id=b5945fe33b684830a6360ec0f1a70097&role.id=ee525f9120064af5a37358b119bbedae => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:03.659254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e03b7-b084-44ed-bc07-d1b320fbf672 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:03.701151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:03.701728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:03.702034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:03.702316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:03.703167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] RBAC: Adding query filter params (role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=0ba528083e754b4f8ef5b418a22cc985) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:03.703482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:03.705021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa2e27-2612-4ec4-b172-be16077aafc4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:03.711803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 47/97] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:03 2022] GET /identity/v3/role_assignments?user.id=0ba528083e754b4f8ef5b418a22cc985&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:05.053560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7ab87-36d2-4e92-adc9-e41ede3067f8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.054645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7ab87-36d2-4e92-adc9-e41ede3067f8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.055126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7ab87-36d2-4e92-adc9-e41ede3067f8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.057377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 51/98] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:05.063098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58704-2269-4d41-b6fb-9b495b6cc96b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.063952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58704-2269-4d41-b6fb-9b495b6cc96b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.064425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58704-2269-4d41-b6fb-9b495b6cc96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.082084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-45a58704-2269-4d41-b6fb-9b495b6cc96b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:05.083636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45a58704-2269-4d41-b6fb-9b495b6cc96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:05.086404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:05.175970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 48/99] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:05.215132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7ab87-36d2-4e92-adc9-e41ede3067f8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:05.246981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:05.340230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7ab87-36d2-4e92-adc9-e41ede3067f8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:05.343984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ddd-b8ee-46a2-af1f-00f083e75871 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.344280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ddd-b8ee-46a2-af1f-00f083e75871 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.344539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ddd-b8ee-46a2-af1f-00f083e75871 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.346268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 49/100] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:05.352263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.352558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.352822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.390699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:05.391920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:05.434570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:05.435392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.435670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.436249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.459093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:05.474414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:05.475553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:05.476533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:05.485511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 52/101] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:05.495152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:05.553942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 50/102] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:05.591422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:05.638353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:05.680203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c747a5-fbf6-4fb5-9bf8-462ffd3b3241 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:05.725795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:05.765520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e48ca2-9087-4641-b546-ba39dcce0e5a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:05.778691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:05.779381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.779666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.779939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.780697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:05.781060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:05.782508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:05.792497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 53/103] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:05.800860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:05.808802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:05.810614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.810996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.811347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.812626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:05.814198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:05.816024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 51/104] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:05.823577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:05.933474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60660a5e-6d49-466a-9801-7363d356c8d5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:05.959409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e80f-780a-4ebc-9284-d164554ad791 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:05.990864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:05.991550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.991831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.992107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:05.992843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:05.994977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:05.997638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:05.998563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:05.998842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:05.999110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] PATH_INFO: `/v3/users/7eb590ff86d1455786a224b4890a40e8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:06.005334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:06.014910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] RBAC: Authorizing `identity:get_user(user_id=7eb590ff86d1455786a224b4890a40e8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:06.016532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:06.018654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 54/105] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:05 2022] GET /identity/v3/users/7eb590ff86d1455786a224b4890a40e8 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:06.024101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:06.030298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:06.064428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 52/106] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:09:05 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:09:06.162579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33901310-37f6-456e-819f-9f950ba94897 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:06.200961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727005e-a252-4dee-bc39-52bcbe93025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:06.201545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727005e-a252-4dee-bc39-52bcbe93025e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:06.201827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727005e-a252-4dee-bc39-52bcbe93025e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:06.202148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727005e-a252-4dee-bc39-52bcbe93025e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:06.284707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727005e-a252-4dee-bc39-52bcbe93025e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:06.286255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727005e-a252-4dee-bc39-52bcbe93025e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:06.288503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:06.401843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 55/107] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:06.407086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:06.538280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962445e8-6809-4e54-8c38-a5cc07f87bcc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:06.538612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962445e8-6809-4e54-8c38-a5cc07f87bcc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:06.538835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962445e8-6809-4e54-8c38-a5cc07f87bcc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:06.540438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 56/108] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:06.546483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:06.546787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:06.547146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:06.560528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ba3a2-0389-41ef-9372-20b045a86a45 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:06.565673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:06.567001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:06.619984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:06.620893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:06.621175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:06.621447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:06.623590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:06.625065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:06.630071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 53/109] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:06 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:06.637575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:06.701267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 57/110] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:06.726454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:06.738693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:06.798464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:06.821205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341976af-fdb9-4c2c-a60f-e8b93a1f75d2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:06.908570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:06.909243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:06.909527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:06.909856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:06.910761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] RBAC: Adding query filter params (role.id=8a9b9fe946844e3fa9690c8965a1a86f, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=7eb590ff86d1455786a224b4890a40e8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:06.911134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:06.912601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:06.927286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 54/111] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:06 2022] GET /identity/v3/role_assignments?user.id=7eb590ff86d1455786a224b4890a40e8&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=8a9b9fe946844e3fa9690c8965a1a86f => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:06.974836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2965e-2a62-493b-9e43-16a2cca0c8d0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:07.036232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8757c72-eb52-4c00-81fb-b909c70c80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:07.037071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757c72-eb52-4c00-81fb-b909c70c80d6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.037354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757c72-eb52-4c00-81fb-b909c70c80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.037628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757c72-eb52-4c00-81fb-b909c70c80d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.053433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8757c72-eb52-4c00-81fb-b909c70c80d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e8757c72-eb52-4c00-81fb-b909c70c80d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:07.061785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:07.062741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:07.063616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 58/112] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:07.074070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.095163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5202935-b531-4df5-bfb7-f2a8da7088a7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.095521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5202935-b531-4df5-bfb7-f2a8da7088a7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.096035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5202935-b531-4df5-bfb7-f2a8da7088a7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.097435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 59/113] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:07.120640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aa381-b46c-42cc-b7e6-48fbd15eccff None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.120972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aa381-b46c-42cc-b7e6-48fbd15eccff None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.121211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aa381-b46c-42cc-b7e6-48fbd15eccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.158312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a89aa381-b46c-42cc-b7e6-48fbd15eccff None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:07.159552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a89aa381-b46c-42cc-b7e6-48fbd15eccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:07.200190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806171b-1b57-471a-b18f-b6904c7ab62a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:07.234387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:07.246738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:07.247614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.247915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.248201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.249014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:07.249546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:07.251256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:07.267470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 55/114] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:07.274303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.299999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 60/115] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:07.358181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4096-76b3-4f5f-a1b6-105b9f6bd6f4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.358511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4096-76b3-4f5f-a1b6-105b9f6bd6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.358673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4096-76b3-4f5f-a1b6-105b9f6bd6f4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.360266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 61/116] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:07.371515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81291-8a5a-4afa-b6fc-c9a042662c29 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.371814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81291-8a5a-4afa-b6fc-c9a042662c29 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.372078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e81291-8a5a-4afa-b6fc-c9a042662c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.415151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-61e81291-8a5a-4afa-b6fc-c9a042662c29 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:07.416895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61e81291-8a5a-4afa-b6fc-c9a042662c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:07.429755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd09a4-9d2e-4155-972b-d50ceb8d0390 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:07.437315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:07.469015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:07.469912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.470293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.470577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.472072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:07.473572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:07.475918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 56/117] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:07 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:07.476224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.510805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 62/118] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:07.512317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911185a-0c2f-4aa7-817a-0ee02c803adc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.518514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911185a-0c2f-4aa7-817a-0ee02c803adc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.518912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911185a-0c2f-4aa7-817a-0ee02c803adc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.520800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 63/119] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:07.521556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911185a-0c2f-4aa7-817a-0ee02c803adc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.543506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:07.616285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd1757-7bcf-44e0-b440-6ede25d59645 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:07.652032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911185a-0c2f-4aa7-817a-0ee02c803adc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:07.664319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5a59c-7e5b-4b55-8a39-d15e7fee3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:07.665149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a59c-7e5b-4b55-8a39-d15e7fee3186 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.666105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a59c-7e5b-4b55-8a39-d15e7fee3186 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.666431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a59c-7e5b-4b55-8a39-d15e7fee3186 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.678488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5a59c-7e5b-4b55-8a39-d15e7fee3186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a7b5a59c-7e5b-4b55-8a39-d15e7fee3186 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:07.687082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:07.689020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 57/120] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:07.690935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.692580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.692580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.701812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:07.702721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.703007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.703287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.705162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:07.706951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:07.709075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 64/121] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:07 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:07.709925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.710225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:07.711673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:07.740730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:07.789282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 58/122] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:07.798989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.852044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e775be-32dc-4200-8a54-0f51fbe71644 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:07.857693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:07.903770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:07.905467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:07.906090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:07.906572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:07.925583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:07.934796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:07.938975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 65/123] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:07.939756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:07.953927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6a230-057d-47cf-b5ef-4ea3a8a2de12 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.006412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.007815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.008367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.008944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.011210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:08.011813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.013459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.026554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 59/124] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:08.031889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.038371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.075709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d0e3-4464-4c30-bae5-89d793066bf9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.116496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.117401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.117697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.118027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/0ba528083e754b4f8ef5b418a22cc985/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.120886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ef364fa7945739dc7d830165cce32, user_id=0ba528083e754b4f8ef5b418a22cc985, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.122338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.140127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 66/125] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:07 2022] PUT /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/0ba528083e754b4f8ef5b418a22cc985/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:08.141026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.168298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ac4b-e46a-4e44-894d-a60bcfd56a91 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.171047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.209612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.210938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.211469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.212043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.225545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:08.234196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:08.235173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:08.235985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:08.239087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 60/126] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:08.240182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.300568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f870e-30d7-459b-a92b-17a144c0e973 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.340853 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.341551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.341834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.342141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.342895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:08.343198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.344746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.355891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 67/127] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:08.356879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.366950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.465296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3521-d952-4413-ad64-00b53b817d52 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.472952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414d29-2c05-459d-98ac-2ebd30c4d204 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.500993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.501676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.501973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.502265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.503009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:08.503313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.504688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.513624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.514592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.514879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.515157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.516420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.516849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 68/128] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:08.517684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.518008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.523656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 61/129] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:08.526255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.564207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.592588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.643047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed166c-01dd-4c50-b75f-21aee947ddf4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.644969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba11f-1abf-4599-8ec8-3430cc24518d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.687795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.688685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.688972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.689258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.691021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.691901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.692183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.692461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.693702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.695924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.697370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.698844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.700530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 69/130] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:08.702063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 62/131] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:08.702587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.706248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.844462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577631a5-c9fe-4cab-a150-df59bcb425c5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:08.881108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.886000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:08.887051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:08.887347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:08.887632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:08.889217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:08.890778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:08.892556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 70/132] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:08.893351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:08.952576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:08.962133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f596c-578d-4697-8d8e-5f346bf5bee5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.010592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a8f7-6ec9-4820-8db7-d76c1681314b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.029563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.029563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.029563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.029563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] PATH_INFO: `/v3/projects/b5945fe33b684830a6360ec0f1a70097` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.034795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] RBAC: Authorizing `identity:get_project(project_id=b5945fe33b684830a6360ec0f1a70097)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.036300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.038094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 63/133] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:08 2022] GET /identity/v3/projects/b5945fe33b684830a6360ec0f1a70097 => generated 312 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:09.038881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:09.048914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.049819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.050137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.050420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/0ba528083e754b4f8ef5b418a22cc985/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.052813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ef364fa7945739dc7d830165cce32, user_id=0ba528083e754b4f8ef5b418a22cc985, role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.054484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.076297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 71/134] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:08 2022] PUT /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/0ba528083e754b4f8ef5b418a22cc985/roles/625fb35ccd424520a9a0766b1d193e60 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:09.083234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:09.184192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:09.276425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d521-cf8f-4349-88fa-bc6d432e1ab7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.291302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05140157-d364-4ff5-869b-a4ad4938353d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.340098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639acf4-bc3c-4799-b2f9-df9ac9f75227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.341360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639acf4-bc3c-4799-b2f9-df9ac9f75227 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.341648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639acf4-bc3c-4799-b2f9-df9ac9f75227 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.341923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639acf4-bc3c-4799-b2f9-df9ac9f75227 None admin] PATH_INFO: `/v3/projects/b5945fe33b684830a6360ec0f1a70097/users/0ba528083e754b4f8ef5b418a22cc985/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.344757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639acf4-bc3c-4799-b2f9-df9ac9f75227 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5945fe33b684830a6360ec0f1a70097, user_id=0ba528083e754b4f8ef5b418a22cc985, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.346564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639acf4-bc3c-4799-b2f9-df9ac9f75227 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.365274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.365949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 72/135] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:09 2022] PUT /identity/v3/projects/b5945fe33b684830a6360ec0f1a70097/users/0ba528083e754b4f8ef5b418a22cc985/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:09.366332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.366619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.366897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.368275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.370483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.371256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5414df-5a33-450d-aa9c-b17b8bf2aefa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.371551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5414df-5a33-450d-aa9c-b17b8bf2aefa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.371887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5414df-5a33-450d-aa9c-b17b8bf2aefa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.372277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 64/136] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:09 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:09.373719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 73/137] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:09.378608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:09.393305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.393934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.394482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.424753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:09.429615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:09.462927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:09.531420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 74/138] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:09.561758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:09.668045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:09.675568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750767be-8f5d-4f88-a759-49223b53890a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.747196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749c4f0-561c-4825-a481-94e75aae99d4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.757531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd5d5e-d440-4f1c-844d-dad5f7947dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.758807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5d5e-d440-4f1c-844d-dad5f7947dbb None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.759345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5d5e-d440-4f1c-844d-dad5f7947dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.759841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5d5e-d440-4f1c-844d-dad5f7947dbb None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/a29912cd78134fb2b757b551f0545235/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.767490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd5d5e-d440-4f1c-844d-dad5f7947dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ef364fa7945739dc7d830165cce32, user_id=a29912cd78134fb2b757b551f0545235, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.769359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd5d5e-d440-4f1c-844d-dad5f7947dbb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.785158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.786137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.786476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.786758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.788282 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.789875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.794195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 75/139] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:09.799880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:09.801297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 65/140] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:09 2022] PUT /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/a29912cd78134fb2b757b551f0545235/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:09.888923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f862ad8-6d09-42ed-baf3-d92597f066dd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.889563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f862ad8-6d09-42ed-baf3-d92597f066dd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.890097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f862ad8-6d09-42ed-baf3-d92597f066dd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.891766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 66/141] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:09.897347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.897919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.898463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.919423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e8b5-ed3f-4e64-a943-695c89458a88 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:09.946386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:09.951007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:09.952400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:09.960332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:09.961554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:09.962777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:09.962777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:09.962984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:09.964502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:09.995837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 76/142] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:09 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:09:10.078960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 67/143] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:10.113347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:10.242549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064f3a8-121f-49ec-951e-744c093099b9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:10.287450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:10.288290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:10.288570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:10.288846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:10.301621 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:10.314106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:10.315157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:10.315949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 77/144] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:10.321398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:10.359090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:10.467217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8da06c-1e99-461c-ab42-a3bf2a3c8a92 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:10.518945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:10.519637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:10.519918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:10.520195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:10.520954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:10.521258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:10.522669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:10.532314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 68/145] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:10.538340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:10.585691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:10.658162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1def9-671b-46ad-866b-f9d5dcc53ed3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:10.695011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:10.695896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:10.696173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:10.696496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] PATH_INFO: `/v3/users/7eb590ff86d1455786a224b4890a40e8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:10.698413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] RBAC: Authorizing `identity:get_user(user_id=7eb590ff86d1455786a224b4890a40e8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:10.699874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:10.701534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 78/146] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:10 2022] GET /identity/v3/users/7eb590ff86d1455786a224b4890a40e8 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:10.707405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:10.806907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:10.824598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264b40-0f4b-4a4d-a071-60e65169e432 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:10.863500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c19aa5-14b2-4cf2-8f69-5054a841c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:10.864413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19aa5-14b2-4cf2-8f69-5054a841c81c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:10.864695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19aa5-14b2-4cf2-8f69-5054a841c81c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:10.864966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19aa5-14b2-4cf2-8f69-5054a841c81c None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:10.866195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c19aa5-14b2-4cf2-8f69-5054a841c81c None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:10.867648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c19aa5-14b2-4cf2-8f69-5054a841c81c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:10.869914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 69/147] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:10 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:10.875812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:11.006548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02511507-71ac-4335-8d12-e353f0557844 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:11.008393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:11.060825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c143821-ef94-424f-8099-fdffa6fe1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:11.061748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c143821-ef94-424f-8099-fdffa6fe1709 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:11.062048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c143821-ef94-424f-8099-fdffa6fe1709 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:11.062320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c143821-ef94-424f-8099-fdffa6fe1709 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/7eb590ff86d1455786a224b4890a40e8/roles/8a9b9fe946844e3fa9690c8965a1a86f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:11.067724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c143821-ef94-424f-8099-fdffa6fe1709 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ef364fa7945739dc7d830165cce32, user_id=7eb590ff86d1455786a224b4890a40e8, role_id=8a9b9fe946844e3fa9690c8965a1a86f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:11.069328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c143821-ef94-424f-8099-fdffa6fe1709 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:11.099454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 79/148] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:10 2022] PUT /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32/users/7eb590ff86d1455786a224b4890a40e8/roles/8a9b9fe946844e3fa9690c8965a1a86f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:11.303996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979813-87b1-4226-8065-fb0258ee960a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:11.304340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979813-87b1-4226-8065-fb0258ee960a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:11.304518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979813-87b1-4226-8065-fb0258ee960a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:11.306860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 70/149] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:11.320113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:11.320415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:11.320672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:11.341260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:11.342484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:11.418146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 80/150] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:11.445662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979813-87b1-4226-8065-fb0258ee960a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:11.575733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979813-87b1-4226-8065-fb0258ee960a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:11.614936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:11.615746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:11.616026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:11.616357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:11.630237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:11.639179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:11.640090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:11.640872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:11.644194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 71/151] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:11.646702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:11.756878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:11.765746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a5c33-d88f-4584-b0e1-c057254d6d1c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:11.805572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:11.806897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:11.807171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:11.807444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:11.808204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:11.808507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:11.810021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:11.822320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 81/152] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:11.828343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:11.847268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:11.951911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f40924-eb98-49af-870e-c902392bd15a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:11.988261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:11.989210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:11.989488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:11.989818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:11.991094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:11.992577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:11.994903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 72/153] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:11 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:12.001250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:12.139502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdceb87-bbde-4a65-afec-a4937c6fda56 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:12.185171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:12.185840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:12.186151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:12.186422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:12.220866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:12.269399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:12.270906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:12.396506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 82/154] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:12.407073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:12.533755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:12.554571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244eb704-7cc4-4aed-8859-0ed856a8fe52 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:12.598101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e25e2-0b4e-48a2-950b-6c504a1b5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:12.598987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e25e2-0b4e-48a2-950b-6c504a1b5e86 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:12.599272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e25e2-0b4e-48a2-950b-6c504a1b5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:12.599549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e25e2-0b4e-48a2-950b-6c504a1b5e86 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:12.600785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e25e2-0b4e-48a2-950b-6c504a1b5e86 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:12.602283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e25e2-0b4e-48a2-950b-6c504a1b5e86 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:12.604044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 73/155] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:12 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:12.610123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:12.674895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:12.683060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5d89-a759-44f8-be29-7d84bc794371 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:12.683640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5d89-a759-44f8-be29-7d84bc794371 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:12.684663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5d89-a759-44f8-be29-7d84bc794371 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:12.689282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 74/156] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:12.694932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:12.695494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:12.695993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:12.727310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:12.728920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:12.733204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ffdf8-05f0-4973-b34f-be66d1e3d31c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:12.788667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:12.789591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:12.790030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:12.790471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:12.791512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=0ba528083e754b4f8ef5b418a22cc985) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:12.791982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:12.793680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:12.805397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 83/157] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:12 2022] GET /identity/v3/role_assignments?user.id=0ba528083e754b4f8ef5b418a22cc985&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=ee525f9120064af5a37358b119bbedae => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:12.844671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 75/158] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:12.892779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:13.027843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6758a-7138-475c-9618-be4399316a12 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:13.054337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:13.074223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:13.075106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:13.075386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:13.075662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:13.096231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:13.104576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:13.105521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:13.106410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:13.110471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 84/159] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:13.119682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:13.249719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:13.280346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570555d-0977-4e1f-b18a-fb4e431c3839 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:13.326855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:13.327813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:13.328248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:13.328687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:13.329587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:13.330064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:13.331616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:13.340970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 76/160] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:13.346930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:13.497675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9b9a1-d0f4-459d-9a00-57b391d91cc9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:13.542729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:13.543175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:13.543454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:13.543728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:13.550814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:13.552327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:13.554402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 85/161] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:13 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:13.559637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:13.707273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5a29-2bd2-4c8b-85a2-fceb44492f1b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:13.757434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8300690-bfc8-4620-9a41-2c7071b2cb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:13.758497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8300690-bfc8-4620-9a41-2c7071b2cb3b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:13.759024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8300690-bfc8-4620-9a41-2c7071b2cb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:13.759523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8300690-bfc8-4620-9a41-2c7071b2cb3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:13.773758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:13.844815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8300690-bfc8-4620-9a41-2c7071b2cb3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:13.846553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8300690-bfc8-4620-9a41-2c7071b2cb3b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:13.952397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 77/162] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:13.959109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:14.035754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:14.125937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85405e8-67d7-4f3f-98bd-6e8cd7ae7bf5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:14.146674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce85494-0b85-47b3-8729-d6b7b86b4142 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.146981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce85494-0b85-47b3-8729-d6b7b86b4142 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.147238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce85494-0b85-47b3-8729-d6b7b86b4142 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.148970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 78/163] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:14.157015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.157325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.157578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.173524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:14.174433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.174717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.174986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.178707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:14.181609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:14.181609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:14.181803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:14.182744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 86/164] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:13 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:14.188731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:14.246830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:14.296355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 79/165] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:14.346491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:14.356379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430d69f-edda-4572-b75e-056b452e6fba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:14.378470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:14.412129 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:14.412802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.413086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.413362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.414225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] RBAC: Adding query filter params (role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=0ba528083e754b4f8ef5b418a22cc985) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:14.414602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:14.416633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ef22d-11e5-4afb-8e39-8443e4d996b9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:14.432066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 87/166] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:14 2022] GET /identity/v3/role_assignments?user.id=0ba528083e754b4f8ef5b418a22cc985&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:14.504114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6faa4-c97b-4e91-9046-8cb9f395d5ef None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.504398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6faa4-c97b-4e91-9046-8cb9f395d5ef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.504884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6faa4-c97b-4e91-9046-8cb9f395d5ef None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.506943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 88/167] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:14.512775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.513536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.514046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.515886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c954e-30af-4242-82c4-faca2a36f272 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:14.559205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:14.560817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:14.566221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:14.567071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.567365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.567647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.598016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:14.608990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:14.610301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:14.611085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:14.615028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 80/168] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:14.620757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:14.687880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 89/169] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:14.689494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:14.744018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:14.826032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18d95-bb02-4222-96c3-b602d0cd6a0e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:14.901867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:14.902572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:14.902855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:14.903131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:14.903884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:14.904190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:14.905614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:14.925681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 81/170] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:14.927600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2a6e6-3584-4282-a504-e31f6dc0c9fe None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:14.934022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:14.966344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:15.008587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80018334-bcf9-4328-891f-854549c6309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.009425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80018334-bcf9-4328-891f-854549c6309e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.009702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80018334-bcf9-4328-891f-854549c6309e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.009988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80018334-bcf9-4328-891f-854549c6309e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.037315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80018334-bcf9-4328-891f-854549c6309e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-80018334-bcf9-4328-891f-854549c6309e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:15.045922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:15.046884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:15.047693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:15.051400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 90/171] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:15.057357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80018334-bcf9-4328-891f-854549c6309e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:15.140572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:15.151496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4fe28-4dae-4ec7-930d-818fc2563d92 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:15.231720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79162b26-3a15-4c15-b4aa-94d7d08e89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.232535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162b26-3a15-4c15-b4aa-94d7d08e89da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.232820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162b26-3a15-4c15-b4aa-94d7d08e89da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.233094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162b26-3a15-4c15-b4aa-94d7d08e89da None admin] PATH_INFO: `/v3/users/a29912cd78134fb2b757b551f0545235` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.234338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79162b26-3a15-4c15-b4aa-94d7d08e89da None admin] RBAC: Authorizing `identity:get_user(user_id=a29912cd78134fb2b757b551f0545235)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:15.235806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79162b26-3a15-4c15-b4aa-94d7d08e89da None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:15.237461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 82/172] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:14 2022] GET /identity/v3/users/a29912cd78134fb2b757b551f0545235 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:15.246991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263657a-9e49-4640-a02d-df290a4bf3fe None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.247283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263657a-9e49-4640-a02d-df290a4bf3fe None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.247543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263657a-9e49-4640-a02d-df290a4bf3fe None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.248980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 83/173] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:15.255071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.255355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.255631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.294101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:15.295304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:15.301086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80018334-bcf9-4328-891f-854549c6309e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:15.366451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.367582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.368167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.369133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.370465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:15.370995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:15.373895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:15.394222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 91/174] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:15.395748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:15.439925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 84/175] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:15.440792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:15.476521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:15.595207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac499754-0d0e-4a53-817d-f6c5ab84d000 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:15.600253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:15.611348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834962bb-010c-4198-a4b6-9da27ba2cee3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:15.649239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.651071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.651598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.652081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] PATH_INFO: `/v3/users/0ba528083e754b4f8ef5b418a22cc985` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.653668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba528083e754b4f8ef5b418a22cc985)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:15.655398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:15.657260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 85/176] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:15 2022] GET /identity/v3/users/0ba528083e754b4f8ef5b418a22cc985 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:15.658377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:15.668776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f2628-1550-4dc5-ad27-a12588639bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.670059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2628-1550-4dc5-ad27-a12588639bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.670558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2628-1550-4dc5-ad27-a12588639bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.671044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2628-1550-4dc5-ad27-a12588639bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.769642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e23872-78e0-41fd-aeda-05914e3e49f3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:15.795309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2628-1550-4dc5-ad27-a12588639bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:15.796813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2628-1550-4dc5-ad27-a12588639bc6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:15.817515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1e827-008c-4093-8e89-8902179fa973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.818354 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e827-008c-4093-8e89-8902179fa973 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.818641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e827-008c-4093-8e89-8902179fa973 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.818916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1e827-008c-4093-8e89-8902179fa973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.830310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1e827-008c-4093-8e89-8902179fa973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1bc1e827-008c-4093-8e89-8902179fa973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:15.838718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:15.839642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 86/177] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:15.847725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a4dc-4a68-480e-90b5-60f458d853a0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.848471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a4dc-4a68-480e-90b5-60f458d853a0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.848471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a4dc-4a68-480e-90b5-60f458d853a0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.848471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 87/178] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:15.848471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a4dc-4a68-480e-90b5-60f458d853a0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:15.853245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:15.870476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:15.936587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 92/179] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:15.936587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7995ac-330d-4ef6-808b-dbcff2065b78 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.936587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7995ac-330d-4ef6-808b-dbcff2065b78 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:15.936587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7995ac-330d-4ef6-808b-dbcff2065b78 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:15.936587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 93/180] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:15.937348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7995ac-330d-4ef6-808b-dbcff2065b78 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:15.963376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a4dc-4a68-480e-90b5-60f458d853a0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:15.998832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783e06-9cbc-452f-a003-2cdbe8dd28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:15.999485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783e06-9cbc-452f-a003-2cdbe8dd28b3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:15.999766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783e06-9cbc-452f-a003-2cdbe8dd28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.000048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783e06-9cbc-452f-a003-2cdbe8dd28b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.039289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7995ac-330d-4ef6-808b-dbcff2065b78 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.069425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783e06-9cbc-452f-a003-2cdbe8dd28b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.070937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783e06-9cbc-452f-a003-2cdbe8dd28b3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.075076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.081497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.082193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.082479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.082753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.083496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:16.083812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.085195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa49de-eb64-4908-823f-dab380ea7dd2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.093148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.093917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 94/181] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:16.095189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b08a10-a9f8-40d1-864e-c2c284800688 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.095737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b08a10-a9f8-40d1-864e-c2c284800688 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.096015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b08a10-a9f8-40d1-864e-c2c284800688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.112687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-41b08a10-a9f8-40d1-864e-c2c284800688 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:16.113871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-41b08a10-a9f8-40d1-864e-c2c284800688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:16.176139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 88/182] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:16.177717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369fd7b-7a29-4c6e-89d7-61f4da0d0104 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.178032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369fd7b-7a29-4c6e-89d7-61f4da0d0104 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.178317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369fd7b-7a29-4c6e-89d7-61f4da0d0104 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.179641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 89/183] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:16.180419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369fd7b-7a29-4c6e-89d7-61f4da0d0104 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.201988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 95/184] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:16.201988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47795099-5e40-456a-992d-425795457a53 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.201988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47795099-5e40-456a-992d-425795457a53 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.201988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47795099-5e40-456a-992d-425795457a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.206893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-47795099-5e40-456a-992d-425795457a53 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:16.208074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-47795099-5e40-456a-992d-425795457a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:16.276099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 96/185] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:16.276944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47795099-5e40-456a-992d-425795457a53 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.286116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369fd7b-7a29-4c6e-89d7-61f4da0d0104 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.307421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.321933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.322850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.323213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.323403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.324581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.326070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.327777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 90/186] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:16.328536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.332425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.381406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47795099-5e40-456a-992d-425795457a53 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.415573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e524be2-2ecc-4dd0-bbd0-df140884e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.416487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524be2-2ecc-4dd0-bbd0-df140884e614 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.416772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524be2-2ecc-4dd0-bbd0-df140884e614 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.417045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524be2-2ecc-4dd0-bbd0-df140884e614 None admin] PATH_INFO: `/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.427622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba37b1-2773-43ce-aef5-44d11df692dc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.433168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e524be2-2ecc-4dd0-bbd0-df140884e614 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3a893a2bb94b40990ea31e4e8bfe98)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.434694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e524be2-2ecc-4dd0-bbd0-df140884e614 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.438424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 97/187] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:16.443970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.444252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.444522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.460790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:16.462308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:16.465743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.466641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.466924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.467198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] PATH_INFO: `/v3/projects/b5945fe33b684830a6360ec0f1a70097` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.468383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] RBAC: Authorizing `identity:get_project(project_id=b5945fe33b684830a6360ec0f1a70097)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.469839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.471857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 91/188] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/projects/b5945fe33b684830a6360ec0f1a70097 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:16.472611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.531081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.537126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 98/189] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:16.537981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.575771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84896c-41f6-4dd9-81c2-5e91e3e6768a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.578753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.610105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.610907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.611192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.611511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.621460 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:16.629238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:16.630266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:16.631072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 92/190] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:16.631733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.641227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801dbad-932b-46d7-bf16-94294908f4d9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.675929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.676748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.677033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.677313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.688144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:16.696453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:16.697423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:16.698270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 99/191] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:16.698960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.742852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827920-813d-4095-8939-2bd2b548c092 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.760972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.780667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.781332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.781617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.781891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.782761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=a29912cd78134fb2b757b551f0545235) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:16.783072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.784616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.791489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 93/192] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/role_assignments?user.id=a29912cd78134fb2b757b551f0545235&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:16.792131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:16.812838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:16.816104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6a70-bd61-4f90-90c0-1218d2ac8c32 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.856552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.857140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.857423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.857700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.919398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7183e9-7f00-42ac-abda-85f45f67e39a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:16.947558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.949342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.961772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:16.963062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:16.963344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:16.963627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:16.964501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=b5945fe33b684830a6360ec0f1a70097, user.id=0ba528083e754b4f8ef5b418a22cc985) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:16.964821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:16.966402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:16.973408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 94/193] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/role_assignments?user.id=0ba528083e754b4f8ef5b418a22cc985&scope.project.id=b5945fe33b684830a6360ec0f1a70097&role.id=ee525f9120064af5a37358b119bbedae => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:16.974335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.053038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.100791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.106814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 100/194] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:17.107966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.137304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2ede8-e5d5-4abc-b595-7a039109704a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.179005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.179244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.179484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.180913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.182577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.184552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 95/195] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.185006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.235016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0881f-09f6-4c8d-8a1b-97f6a176b66b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.274508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.275769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.276055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.276327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.277068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:17.277368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.278787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.287238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 101/196] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.288036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.304314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524e55-36b0-47db-af41-5aff5c68f3e4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.317767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.339976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.340680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.340968 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.341246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.342018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:17.342337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.343735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.349403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.351975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 96/197] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.352797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.390683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7798d68-4130-4cf8-b75d-477249501be4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.423018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.423878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.424160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.424431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.427204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.430439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.432739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 102/198] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.433507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.466199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155f27-c670-4e7d-971f-66d1ea67bb8a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.504324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.505008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.505291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.505563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.506352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.507800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.528400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 97/199] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:17 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:17.531100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.557008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430050-f2a5-4f19-8d80-e1b2580eef38 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.565708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.597499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.604738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.605637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.605925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.606238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] PATH_INFO: `/v3/users/7eb590ff86d1455786a224b4890a40e8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.607488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] RBAC: Authorizing `identity:get_user(user_id=7eb590ff86d1455786a224b4890a40e8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.608983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.615559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 103/200] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/users/7eb590ff86d1455786a224b4890a40e8 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.615559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.653635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eea1be-f429-4c54-a3c0-cf329623230e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.694859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.695767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.696045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.696363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] PATH_INFO: `/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.697697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3a893a2bb94b40990ea31e4e8bfe98)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.699223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.702047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 98/201] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.702047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.741604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b5dd-7c7d-4bf5-80e3-34ae1495909e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.779373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.780130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.780418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.780696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.781541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=cc3a893a2bb94b40990ea31e4e8bfe98) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:17.781855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:17.783355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:17.792083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 104/202] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/role_assignments?user.id=cc3a893a2bb94b40990ea31e4e8bfe98&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:17.792083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:17.838833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.844253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0ac96-52f1-4596-8de1-6ef4246728b2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:17.896020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:17.896946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:17.897815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:17.898227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:17.899012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:17.961640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdb947-5daa-41d9-985a-f14f2d91de9c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:18.010799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:18.011461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:18.011738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:18.012007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:18.053179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:18.054738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:18.125605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:18.128588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:18.202259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:18.248143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 105/203] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:18.253199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:18.324189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:18.331208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 99/204] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:18.337381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:18.404687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb769eb1-640a-48ad-b317-a42782ae6726 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:18.447547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:18.448406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:18.448680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:18.448947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:18.450166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:18.452809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:18.459609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 106/205] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:18 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:18.460883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:18.500874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d20bc0-0bd1-430c-b208-8bb3fd194d83 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:18.526316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:18.538601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:18.539626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:18.540042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:18.540414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:18.541780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:18.543377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:18.545524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 100/206] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:18 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:18.551113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:18.632861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a2de-fbd3-4169-98e0-3eeb86a97676 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:18.685272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:18.706064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:18.706730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:18.707012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:18.707287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:18.708121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] RBAC: Adding query filter params (role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=cc3a893a2bb94b40990ea31e4e8bfe98) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:18.708434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:18.709955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862db1e-8b47-4cb7-b7f9-5648767fafaa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:18.726039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 107/207] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:18 2022] GET /identity/v3/role_assignments?user.id=cc3a893a2bb94b40990ea31e4e8bfe98&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:18.733023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53b27-020f-445e-b9c0-f09031fd1379 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:18.778417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:18.779023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:18.779305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:18.779581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:18.780439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] RBAC: Adding query filter params (role.id=8a9b9fe946844e3fa9690c8965a1a86f, scope.project.id=8f1ef364fa7945739dc7d830165cce32, user.id=7eb590ff86d1455786a224b4890a40e8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:18.780752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:18.782300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4d03-f20c-4769-9ddc-68afb64a35a4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:18.789690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 101/208] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:18 2022] GET /identity/v3/role_assignments?user.id=7eb590ff86d1455786a224b4890a40e8&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=8a9b9fe946844e3fa9690c8965a1a86f => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:20.221456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae057-1ed0-4ac4-9d33-38a0abcfb0d4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.222006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae057-1ed0-4ac4-9d33-38a0abcfb0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.222006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae057-1ed0-4ac4-9d33-38a0abcfb0d4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.223616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 108/209] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:20.226854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b12e9-a0ba-4794-89e4-5980751e7ddc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.227325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b12e9-a0ba-4794-89e4-5980751e7ddc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.227479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b12e9-a0ba-4794-89e4-5980751e7ddc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.229079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 102/210] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:20.231555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f6da-0010-424b-a0ba-6885311a234e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.232091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f6da-0010-424b-a0ba-6885311a234e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.232561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8f6da-0010-424b-a0ba-6885311a234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.235622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.235910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.236192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.250945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e4f8f6da-0010-424b-a0ba-6885311a234e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:20.252126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4f8f6da-0010-424b-a0ba-6885311a234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:20.254268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:20.255552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:20.334481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 109/211] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:20.337852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72aa0-09cc-4948-b91e-72c5e261a167 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.337852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72aa0-09cc-4948-b91e-72c5e261a167 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.337852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72aa0-09cc-4948-b91e-72c5e261a167 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.337852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 110/212] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:20.345219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.345823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.346083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.349549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 103/213] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:20.360116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.371827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:20.373413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:20.396169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:20.428373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:20.469986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 111/214] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:20.469986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.475139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec746b2-c8d5-49b1-9d08-1248a9644b2a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:20.516265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:20.517070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.517347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.517617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.531696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:20.539595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:20.541194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 104/215] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:20.547078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.616511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871863c-d714-4e54-b0f6-189d5bbbf440 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:20.658350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:20.659155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.659437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.659705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.674314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:20.678406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ba93c-392b-4c83-a010-cc1d36bd9680 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:20.683344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:20.684286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:20.685829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:20.688871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 112/216] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:20.689781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.704663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:20.713095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:20.728329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:20.729503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.729981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.730450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.732390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:20.734930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:20.741950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 105/217] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:20.741950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.823422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedcc8f-7fda-4b93-90cb-12f6711e2da6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:20.862974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab24a4-7fc6-402e-a8f4-2e06ada57b83 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:20.868699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:20.869386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.869664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.870529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.870720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:20.871027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:20.872436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:20.886130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 113/218] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:20.886130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.912054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:20.912833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:20.913119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:20.913398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:20.914187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:20.914497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:20.916409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:20.926971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 106/219] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:20.927626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:20.987842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:21.001836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:21.015354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa3ca3-0899-44e2-8bc8-0618b8b5f847 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:21.061070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:21.061795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.062049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.062324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.063153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:21.064499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:21.066165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665863f-7275-4c6f-a8cc-7c47b4389962 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:21.093386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 114/220] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:20 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:21.103017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:21.121785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:21.122829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.123116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.123527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] PATH_INFO: `/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.124951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3a893a2bb94b40990ea31e4e8bfe98)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:21.126716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:21.128951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 107/221] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:20 2022] GET /identity/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:21.135154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:21.263854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edbf1d-c25d-48f4-b42f-ca652b693625 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:21.299098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c378-56cd-4072-bbf9-5d87ad13a994 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:21.305214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:21.312188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff9701-3611-4ab4-ae4d-73780da5fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:21.313813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff9701-3611-4ab4-ae4d-73780da5fdcd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.313813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff9701-3611-4ab4-ae4d-73780da5fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.314221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff9701-3611-4ab4-ae4d-73780da5fdcd None admin] PATH_INFO: `/v3/users/9b0415b0c5e74a31be3075f9beae27fa` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.326415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:21.332852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff9701-3611-4ab4-ae4d-73780da5fdcd None admin] RBAC: Authorizing `identity:get_user(user_id=9b0415b0c5e74a31be3075f9beae27fa)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:21.334458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff9701-3611-4ab4-ae4d-73780da5fdcd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:21.336230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 115/222] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:21 2022] GET /identity/v3/users/9b0415b0c5e74a31be3075f9beae27fa => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:21.342609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5b6e-88ee-4ea1-b81a-9b2f65b2f247 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.343087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5b6e-88ee-4ea1-b81a-9b2f65b2f247 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.343237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5b6e-88ee-4ea1-b81a-9b2f65b2f247 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.345945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 116/223] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:21.345945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5b6e-88ee-4ea1-b81a-9b2f65b2f247 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:21.347865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331864f-7784-4e05-9753-3fb5e02f9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:21.348738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331864f-7784-4e05-9753-3fb5e02f9d64 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.349021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331864f-7784-4e05-9753-3fb5e02f9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.349553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331864f-7784-4e05-9753-3fb5e02f9d64 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.350664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331864f-7784-4e05-9753-3fb5e02f9d64 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:21.353247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331864f-7784-4e05-9753-3fb5e02f9d64 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:21.354810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 108/224] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:21 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:21.355829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.356112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.356385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.376438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:21.378730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:21.484977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 109/225] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:21.485861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:21.526025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5b6e-88ee-4ea1-b81a-9b2f65b2f247 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:21.595955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:21.596810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.597095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.597382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.685327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ac1b-3cab-45e2-80bf-2b99c11d8d9d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:21.715967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:21.732855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:21.738677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:21.743208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:21.776427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:21.778802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:21.779664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:21.780566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56/users/cc3a893a2bb94b40990ea31e4e8bfe98/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:21.788645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=91205116ad304c9288bc0d5380b39f56, user_id=cc3a893a2bb94b40990ea31e4e8bfe98, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:21.792705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:21.829577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 110/226] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:21 2022] PUT /identity/v3/projects/91205116ad304c9288bc0d5380b39f56/users/cc3a893a2bb94b40990ea31e4e8bfe98/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:21.833896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:22.071856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 117/227] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:22.079516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:22.149628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c4053-2cfa-4ae6-8c47-fb4cd9c600f5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:22.195038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:22.197135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:22.197444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:22.199082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:22.231456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:22.241937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:22.242978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:22.244304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:22.252031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 111/228] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:22.259885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:22.284790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:22.311869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4fbb-eec3-4d5f-b46e-aa4072aa56d0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:22.339516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:22.379144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:22.380018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:22.380304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:22.380576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:22.382522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:22.384054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:22.391154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 118/229] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:22 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:22.393757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:22.466481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79ae56-c6f6-4359-83f0-09d289e15166 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:22.567485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:22.568173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:22.568455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:22.568729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:22.569486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:22.569792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:22.572792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:22.591751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 112/230] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:22.597794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:22.617623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1851a-073a-4f51-8f5f-8335653ec3fe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:22.665376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:22.666087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:22.666372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:22.666645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:22.667501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=9b0415b0c5e74a31be3075f9beae27fa) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:22.667816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:22.669589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:22.686456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 119/231] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:22 2022] GET /identity/v3/role_assignments?user.id=9b0415b0c5e74a31be3075f9beae27fa&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=ee525f9120064af5a37358b119bbedae => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:22.797911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:22.802738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8392661-7ca4-4d17-951f-af2f40385b42 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:22.849843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:22.850706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:22.850990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:22.851267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] PATH_INFO: `/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:22.852957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] RBAC: Authorizing `identity:get_user(user_id=cc3a893a2bb94b40990ea31e4e8bfe98)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:22.854499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:22.856657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 113/232] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:22 2022] GET /identity/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:22.862163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:22.910820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:23.022211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dcb2a-c2dd-4ad7-81f9-47dd9fc1f234 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:23.076526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92576f6a-c498-4d26-a36d-52b987655ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:23.077644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92576f6a-c498-4d26-a36d-52b987655ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:23.078125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92576f6a-c498-4d26-a36d-52b987655ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:23.078549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92576f6a-c498-4d26-a36d-52b987655ce1 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:23.079912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92576f6a-c498-4d26-a36d-52b987655ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:23.081554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92576f6a-c498-4d26-a36d-52b987655ce1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:23.083475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 120/233] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:22 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:23.089643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:23.241519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501550f-7615-424a-8ae0-de0c1b69398a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:23.281554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846031-4c79-4642-a147-091daf1b76b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:23.282496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846031-4c79-4642-a147-091daf1b76b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:23.282781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846031-4c79-4642-a147-091daf1b76b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:23.283056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846031-4c79-4642-a147-091daf1b76b8 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56/users/cc3a893a2bb94b40990ea31e4e8bfe98/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:23.285349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67846031-4c79-4642-a147-091daf1b76b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=91205116ad304c9288bc0d5380b39f56, user_id=cc3a893a2bb94b40990ea31e4e8bfe98, role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:23.286855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67846031-4c79-4642-a147-091daf1b76b8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:23.322584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 114/234] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:23 2022] PUT /identity/v3/projects/91205116ad304c9288bc0d5380b39f56/users/cc3a893a2bb94b40990ea31e4e8bfe98/roles/625fb35ccd424520a9a0766b1d193e60 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:24.065677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22c08-25ab-4ac5-9067-1001779b2d4e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.066226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22c08-25ab-4ac5-9067-1001779b2d4e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.066226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22c08-25ab-4ac5-9067-1001779b2d4e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.067875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 121/235] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:24.073530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226497a-9582-4d3f-93aa-177fff066163 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.074024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226497a-9582-4d3f-93aa-177fff066163 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.074103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226497a-9582-4d3f-93aa-177fff066163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.092016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e226497a-9582-4d3f-93aa-177fff066163 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:24.093219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e226497a-9582-4d3f-93aa-177fff066163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:24.115728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:24.171465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 115/236] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:24.199230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22c08-25ab-4ac5-9067-1001779b2d4e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:24.246811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6de4a5-515a-43a9-ba72-450851fecfa7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.247506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6de4a5-515a-43a9-ba72-450851fecfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.247901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6de4a5-515a-43a9-ba72-450851fecfa7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.249833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 116/237] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:24.267328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ebfe5-297f-41d6-a8c5-c4c956ab3375 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.267723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ebfe5-297f-41d6-a8c5-c4c956ab3375 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.268092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ebfe5-297f-41d6-a8c5-c4c956ab3375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.303461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-178ebfe5-297f-41d6-a8c5-c4c956ab3375 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:24.304706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-178ebfe5-297f-41d6-a8c5-c4c956ab3375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:24.325777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22c08-25ab-4ac5-9067-1001779b2d4e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:24.329702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:24.363293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:24.364645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.364908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.365179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.366414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:24.368487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:24.370199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 122/238] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:24.376355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:24.490335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a81b4-581d-4b2d-b5f6-a3987cff1e23 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:24.527904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:24.528578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.528856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.529128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.529829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:24.531452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:24.555378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 123/239] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:24 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:09:24.585033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 117/240] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:24.633917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:24.656260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:24.754000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b452275-ee36-4038-8274-1513a52321d2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:24.776071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e413d-960f-4e40-bf10-0982a3ee5684 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.776731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e413d-960f-4e40-bf10-0982a3ee5684 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.777226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e413d-960f-4e40-bf10-0982a3ee5684 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.779016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 118/241] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:24.785125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.785443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.785816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.824029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:24.824957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:24.826009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:24.826478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:24.826961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:24.829100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:24.851349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:24.859683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:24.860622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:24.861443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:24.864346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 124/242] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:24.871182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:24.967661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 119/243] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:24.971866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:25.009691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee98d-fd69-4aff-a6e5-71c8541ddd66 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:25.016586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:25.045156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:25.068711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:25.070145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.070145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.070145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.070755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:25.072939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:25.074582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:25.085449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 125/244] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:25.090525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:25.169942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164be7a-e5d0-42ba-a7f9-f50ac03c5e9e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:25.216968 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:25.217796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.218155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.218431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.234955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:25.242422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3b854-fc4e-47cb-905c-df336776665e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:25.247040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:25.248040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:25.248845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 120/245] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:25.256572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:25.294161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:25.295486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.295918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.296716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] PATH_INFO: `/v3/users/cbc998d5d42646ef9330fb70d5f347f7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.300629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:25.316453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] RBAC: Authorizing `identity:get_user(user_id=cbc998d5d42646ef9330fb70d5f347f7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:25.318546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:25.321765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 126/246] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:25 2022] GET /identity/v3/users/cbc998d5d42646ef9330fb70d5f347f7 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:25.327287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:25.360978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:25.404041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216a2ac-e3e2-49cb-9cd9-46ebc4a8b677 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:25.443414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:25.444014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.444298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.444575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.445335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:25.445641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:25.447664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:25.457240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 121/247] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:25.464369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:25.556263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f32b03-51ec-4167-b172-20cee419120b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:25.638805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f270826-7051-46a4-ad72-8374c441d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:25.639486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f270826-7051-46a4-ad72-8374c441d01a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.639768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f270826-7051-46a4-ad72-8374c441d01a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.640044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f270826-7051-46a4-ad72-8374c441d01a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.690055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1ccd-e4c3-4568-b6b0-587d97e6e2e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:25.744096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd5ff3-8843-4993-bbd5-0113e906a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:25.745431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5ff3-8843-4993-bbd5-0113e906a600 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.745650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:25.745799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5ff3-8843-4993-bbd5-0113e906a600 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.746197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5ff3-8843-4993-bbd5-0113e906a600 None admin] PATH_INFO: `/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.750834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5ff3-8843-4993-bbd5-0113e906a600 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3a893a2bb94b40990ea31e4e8bfe98)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:25.752453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5ff3-8843-4993-bbd5-0113e906a600 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:25.752716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f270826-7051-46a4-ad72-8374c441d01a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:25.754455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f270826-7051-46a4-ad72-8374c441d01a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:25.754698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 122/248] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:25 2022] GET /identity/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:25.756094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beed9b-8d46-46f9-87cf-764aeb1f8958 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.756380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beed9b-8d46-46f9-87cf-764aeb1f8958 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.756658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beed9b-8d46-46f9-87cf-764aeb1f8958 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.758003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 123/249] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:25.763238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beed9b-8d46-46f9-87cf-764aeb1f8958 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:25.778445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:25.865838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 127/250] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:25.871572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:25.872135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:25.872644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:25.892437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:25.894120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:25.975249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beed9b-8d46-46f9-87cf-764aeb1f8958 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.011958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 128/251] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:26.015325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.035940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8708d-d015-4883-ab38-d3dddad23d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.036653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8708d-d015-4883-ab38-d3dddad23d44 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.037185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8708d-d015-4883-ab38-d3dddad23d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.037411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8708d-d015-4883-ab38-d3dddad23d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.049618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:26.139809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080753f-1c7f-4338-8699-e687c6f03922 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.178885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.180192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.180724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.181165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.182683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:26.184188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:26.186165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:26.186760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.200666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8708d-d015-4883-ab38-d3dddad23d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:26.202864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8708d-d015-4883-ab38-d3dddad23d44 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:26.211340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:26.314575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:26.315795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 124/253] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:26.317372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b5191-bc7e-49fa-afbb-77981c47f71d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.317874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b5191-bc7e-49fa-afbb-77981c47f71d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.318547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b5191-bc7e-49fa-afbb-77981c47f71d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.320088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 125/254] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:26.321103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b5191-bc7e-49fa-afbb-77981c47f71d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.334962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29e58-729f-4ccc-9292-b2e2bf59df98 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.381996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782dbde-06c6-4189-98fd-32bc952d5db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.382810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dbde-06c6-4189-98fd-32bc952d5db8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.383085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dbde-06c6-4189-98fd-32bc952d5db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.383950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dbde-06c6-4189-98fd-32bc952d5db8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.398207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782dbde-06c6-4189-98fd-32bc952d5db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f782dbde-06c6-4189-98fd-32bc952d5db8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:26.408301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:26.409212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:26.410034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 130/255] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:26.411225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.411671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.412647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.434644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:26.435815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:26.449985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b5191-bc7e-49fa-afbb-77981c47f71d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.463693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:26.502953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.503967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.504491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.504961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.506000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] RBAC: Adding query filter params (role.id=8a9b9fe946844e3fa9690c8965a1a86f, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=cbc998d5d42646ef9330fb70d5f347f7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:26.506607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:26.511463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:26.518539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 126/256] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/role_assignments?user.id=cbc998d5d42646ef9330fb70d5f347f7&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=8a9b9fe946844e3fa9690c8965a1a86f => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:26.519078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 131/257] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:26.519832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.522827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.666224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa15e-a986-4837-8fa8-8039d820dd8a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.711248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.712747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.713026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.713576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.714857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:26.716339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:26.722819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 127/258] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:26.723779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.749946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:26.775192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8151ee-70df-4059-be86-5742adf4ee64 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.780137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:26.814659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.815436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.815719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.815988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.816744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:26.817047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:26.819458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:26.830369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 132/259] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:26.831265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:26.857952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645b0b-5841-4fbd-bc08-d672ffdc61c2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:26.899133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:26.900063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:26.900344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:26.900617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:26.912960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:26.924683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:26.925580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:26.926431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:26.930061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 128/260] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:26.932489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:27.044509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b268e4-c99a-457b-a89b-44e098c1b394 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.045860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:27.057784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3c1c0-9a0a-4aa2-814a-d59c1d561723 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.118504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:27.119166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.119448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.119723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.120559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=cc3a893a2bb94b40990ea31e4e8bfe98) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:27.120869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:27.122371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:27.133068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:27.134009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.134298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.134573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] PATH_INFO: `/v3/users/9b0415b0c5e74a31be3075f9beae27fa` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.138605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] RBAC: Authorizing `identity:get_user(user_id=9b0415b0c5e74a31be3075f9beae27fa)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:27.140095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:27.141987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 129/261] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/users/9b0415b0c5e74a31be3075f9beae27fa => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:27.142681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 133/262] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:26 2022] GET /identity/v3/role_assignments?user.id=cc3a893a2bb94b40990ea31e4e8bfe98&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:27.143203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:27.147243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:27.170536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:27.389886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3114d-fcda-497b-a6e7-08d6a27a832a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.403136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d645-4ed6-4c37-9715-9624da6aa072 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.469331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:27.470242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.470788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.471056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.472493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:27.474444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:27.476795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 134/263] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:27 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:27.482810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:27.486820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:27.487708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.488199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.488472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.489233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:27.489541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:27.497988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:27.516343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 130/264] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:27.527078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:27.608125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:27.618614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:27.669321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dcaef-c3bb-4553-a92b-060bfedbaf25 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.734321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:27.735422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.735701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.737330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56/users/9b0415b0c5e74a31be3075f9beae27fa/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.740901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] RBAC: Authorizing `identity:create_grant(project_id=91205116ad304c9288bc0d5380b39f56, user_id=9b0415b0c5e74a31be3075f9beae27fa, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:27.742438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:27.755795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463432b-8191-4fc0-a37f-56530f58e052 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.770464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 135/265] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:27 2022] PUT /identity/v3/projects/91205116ad304c9288bc0d5380b39f56/users/9b0415b0c5e74a31be3075f9beae27fa/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:09:27.811637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eab7e-a459-4e51-928f-d0e8cb080b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:27.812661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eab7e-a459-4e51-928f-d0e8cb080b18 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.812942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eab7e-a459-4e51-928f-d0e8cb080b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.813214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eab7e-a459-4e51-928f-d0e8cb080b18 None admin] PATH_INFO: `/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.814653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111eab7e-a459-4e51-928f-d0e8cb080b18 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3a893a2bb94b40990ea31e4e8bfe98)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:27.816174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111eab7e-a459-4e51-928f-d0e8cb080b18 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:27.821508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 131/266] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:27 2022] GET /identity/v3/users/cc3a893a2bb94b40990ea31e4e8bfe98 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:27.824356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:27.826875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4acd6-21a3-4980-a2c6-448771b82195 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.827158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4acd6-21a3-4980-a2c6-448771b82195 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.827481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4acd6-21a3-4980-a2c6-448771b82195 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.829302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 132/267] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:27.836037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cf23-e9e2-4748-b5cb-dbbab6455c3a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.836037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cf23-e9e2-4748-b5cb-dbbab6455c3a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.836037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cf23-e9e2-4748-b5cb-dbbab6455c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.867186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4c65cf23-e9e2-4748-b5cb-dbbab6455c3a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:27.868577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4c65cf23-e9e2-4748-b5cb-dbbab6455c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:27.954565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94e72-54ee-47b2-ac7a-1b6dba22f50d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:27.979776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 133/268] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:27.987684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae578bf-45ef-4151-9880-5a24fa1bde2e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.988045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae578bf-45ef-4151-9880-5a24fa1bde2e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.988251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae578bf-45ef-4151-9880-5a24fa1bde2e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:27.989991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 134/269] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:27.995534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:27.995820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:27.996087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.009204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.010325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.010820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.012618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.018325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.027277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:28.029369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:28.067157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.098832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.100330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.119544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 135/270] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:28.120219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.244188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dad1cb-8076-488b-be26-f5eb9eefcbec None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.244585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 136/271] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:28.245390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.281606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.282441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.282716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.282981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.288936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.299465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:28.308363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:28.309368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:28.310251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 136/272] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:28.312032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.332578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.373650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d288eb-0055-43c7-ba5c-9ececda4955e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.412192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.413038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.413484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.414021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.416142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.417887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.420410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 137/273] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:28.421505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.456562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab963e-fea8-4fc2-a374-46dee6255fcd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.500564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.502019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.502920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.503670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.505089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.507705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.514627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 137/274] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:28.515785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.546615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97dc4c-3cc7-4dc9-ab72-64e5c1338c17 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.549848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.589549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.590820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.591312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.591958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.593441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:28.594058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.596571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.609475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 138/275] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:28.610729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.625547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.647304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaecfcc-2d88-4047-88eb-5a5093e96828 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.688203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.688922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.689271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.689618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.690496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.692444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.724744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 138/276] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:28 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:28.724744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.808419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a79c7e-dd1a-48e2-a143-5988315872c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.857341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f35e-f333-4bb2-bf55-b1bddc00814a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:28.900318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.901566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.901917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.902358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] PATH_INFO: `/v3/users/c114ff523de9439395bf7c77cbba3caf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.920374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:28.923137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] RBAC: Authorizing `identity:get_user(user_id=c114ff523de9439395bf7c77cbba3caf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.925141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.928414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 139/277] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/users/c114ff523de9439395bf7c77cbba3caf => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:28.933905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:28.935522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:28.936153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:28.936435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:28.936707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:28.937552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] RBAC: Adding query filter params (role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=cc3a893a2bb94b40990ea31e4e8bfe98) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:28.937862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:28.948828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf852-0710-4e1d-81a4-4487a985be68 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:28.977217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 139/278] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/role_assignments?user.id=cc3a893a2bb94b40990ea31e4e8bfe98&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:29.092137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd696-91fd-4dcb-9f1f-1908eeeed699 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:29.138605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:29.139698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:29.140202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:29.140718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:29.141886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, user.id=c114ff523de9439395bf7c77cbba3caf, scope.system=all) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:29.142511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:29.144355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51749098-48af-4175-8c47-5d67bb4312c3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:29.152258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 140/279] 10.222.0.61 () {56 vars in 1308 bytes} [Fri May 27 03:09:28 2022] GET /identity/v3/role_assignments?user.id=c114ff523de9439395bf7c77cbba3caf&scope.system=all&role.id=ee525f9120064af5a37358b119bbedae => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:29.367715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4041-9695-41e4-a1da-db58a6706a1a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:29.368212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4041-9695-41e4-a1da-db58a6706a1a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:29.368212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4041-9695-41e4-a1da-db58a6706a1a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:29.369564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 140/280] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:29.375265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:29.375561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:29.375844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:29.393522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:29.394771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:29.462647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:29.476094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 141/281] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:29.499758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4041-9695-41e4-a1da-db58a6706a1a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:29.538948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:29.658785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4041-9695-41e4-a1da-db58a6706a1a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:29.709456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:29.710287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:29.710571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:29.710844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:29.727749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:29.735317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:29.736229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:29.737054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 141/282] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:29.745052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:29.919044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff145dc7-b582-4d00-9358-f2330e8f0546 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:29.960071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:29.961136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:29.961678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:29.962210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:29.963178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:29.963714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:29.965338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:29.974674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 142/283] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:29.981289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:30.107420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:30.124965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf5cba-5a4c-4e98-8d8d-4e4bb9e75bb0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:30.177082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c796b-d240-4158-8741-36f98e6a7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:30.178336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c796b-d240-4158-8741-36f98e6a7b5a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.178842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c796b-d240-4158-8741-36f98e6a7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.179335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c796b-d240-4158-8741-36f98e6a7b5a None admin] PATH_INFO: `/v3/users/cbc998d5d42646ef9330fb70d5f347f7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.185789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c796b-d240-4158-8741-36f98e6a7b5a None admin] RBAC: Authorizing `identity:get_user(user_id=cbc998d5d42646ef9330fb70d5f347f7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:30.187660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c796b-d240-4158-8741-36f98e6a7b5a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:30.189926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 142/284] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:29 2022] GET /identity/v3/users/cbc998d5d42646ef9330fb70d5f347f7 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:30.196484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:30.265823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:30.314447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb72f5f-77f9-4586-b904-156cf8634b02 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:30.344305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49681-d70a-4315-894e-5e87da5ebc66 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.344625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49681-d70a-4315-894e-5e87da5ebc66 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.344862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c49681-d70a-4315-894e-5e87da5ebc66 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.346730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 143/285] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:30.354087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.354087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.354087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.363733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:30.364888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.365426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.365900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.368090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:30.369777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:30.369886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:30.371010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:30.372696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 143/286] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:30 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:30.384032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:30.490700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 144/287] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:30.535336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:30.556699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac015d-df7b-4e78-ab21-965045ca75fd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:30.610657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:30.654476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:30.662678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:30.663598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.663884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.664163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56/users/cbc998d5d42646ef9330fb70d5f347f7/roles/8a9b9fe946844e3fa9690c8965a1a86f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.666986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c080-6816-447d-aa57-36c0eaa9a02b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:30.669396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=91205116ad304c9288bc0d5380b39f56, user_id=cbc998d5d42646ef9330fb70d5f347f7, role_id=8a9b9fe946844e3fa9690c8965a1a86f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:30.670887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:30.697427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 144/288] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:09:30 2022] PUT /identity/v3/projects/91205116ad304c9288bc0d5380b39f56/users/cbc998d5d42646ef9330fb70d5f347f7/roles/8a9b9fe946844e3fa9690c8965a1a86f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:30.728219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:30.729053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.729334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.729603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.744233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:30.751999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:30.752909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:30.753754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 145/289] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:30.760058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:30.933547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a6dd-7136-4f6b-a0db-54e3d9edd9c3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:30.970783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:30.971454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:30.971731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:30.972005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:30.972744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:30.973051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:30.974478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:30.984275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 145/290] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:30.988845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:31.126898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b7a0-240f-4a69-a61b-5e709a1ad292 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:31.178821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:31.179803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:31.180038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:31.180845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] PATH_INFO: `/v3/users/9b0415b0c5e74a31be3075f9beae27fa` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:31.182061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] RBAC: Authorizing `identity:get_user(user_id=9b0415b0c5e74a31be3075f9beae27fa)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:31.183503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:31.188837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 146/291] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:30 2022] GET /identity/v3/users/9b0415b0c5e74a31be3075f9beae27fa => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:31.191155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:31.272104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:31.347308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef295d0-0393-4634-aa3c-4e7ab9fbcf2b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:31.411176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7841c-25ee-4d62-8a0b-16350289699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:31.411845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7841c-25ee-4d62-8a0b-16350289699c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:31.412124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7841c-25ee-4d62-8a0b-16350289699c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:31.412400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7841c-25ee-4d62-8a0b-16350289699c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:31.534351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7841c-25ee-4d62-8a0b-16350289699c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:31.536331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7841c-25ee-4d62-8a0b-16350289699c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:31.630365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:31.680849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 146/292] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:31.686590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:31.721350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:31.809133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497d5f3-48c0-4a7c-98f6-4b12ded61061 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:31.828763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d73cb-98df-4ca4-9866-dead121911bf None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:31.829406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d73cb-98df-4ca4-9866-dead121911bf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:31.829900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d73cb-98df-4ca4-9866-dead121911bf None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:31.831553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 147/293] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:31.844451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:31.845068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:31.845813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:31.853046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:31.856517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:31.856792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:31.857103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:31.858624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:31.860092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:31.873285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 147/294] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:31 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:31.875038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:31.884698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:31.887215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:32.027834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 148/295] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:32.052941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.060438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.080778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7707a6-7902-48ed-990a-f876d72b1460 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.131529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.132743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.133791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.134716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.135990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=9b0415b0c5e74a31be3075f9beae27fa) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:32.136500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:32.138778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b18f2-e1f9-4c99-8107-22f1a056d4a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:32.153405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 148/296] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:31 2022] GET /identity/v3/role_assignments?user.id=9b0415b0c5e74a31be3075f9beae27fa&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=ee525f9120064af5a37358b119bbedae => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:32.153405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a782d-ddb9-4d4d-9dd6-982f5de85e89 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.153405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a782d-ddb9-4d4d-9dd6-982f5de85e89 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.153405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a782d-ddb9-4d4d-9dd6-982f5de85e89 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.154257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 149/297] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:32.161498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.161827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.162094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.187831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.200167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:32.201392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:32.244495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5eca67-ca53-4778-a455-736a154049a8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.293051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbcad3-461a-41d3-9adc-41c942580fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.293786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbcad3-461a-41d3-9adc-41c942580fab None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.294111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbcad3-461a-41d3-9adc-41c942580fab None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.294389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbcad3-461a-41d3-9adc-41c942580fab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.308829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbcad3-461a-41d3-9adc-41c942580fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-dacbcad3-461a-41d3-9adc-41c942580fab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:32.316818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:32.317801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 149/298] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:32.323737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c48e6-7e50-462d-a801-0daf4c2417a6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.324454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c48e6-7e50-462d-a801-0daf4c2417a6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.324454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c48e6-7e50-462d-a801-0daf4c2417a6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.325899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 150/299] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:32.327355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.327639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.327912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.328846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 150/300] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:32.330242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.347492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:32.348703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:32.430413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 151/301] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:32.430413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.442623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.467378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa33d-f0bc-4a6b-85bd-9d50b8fa433a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.506202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.510084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.510084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.510084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.510084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.510427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:32.510501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:32.512712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:32.525457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 151/302] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:32.530138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.553104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6050e-9da3-4ca5-b866-6880d009acf7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.591797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.592698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.592991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.593262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.605000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:32.613154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:32.614191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:32.615004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:32.619664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 152/303] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:32.620413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.652590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa38b-59a8-427c-9641-4ee3290a70ca None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.693163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.693977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.694287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.694535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.696264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:32.697712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:32.702023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 152/304] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:32.702023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.712184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.738499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d6598-c26d-435e-afc8-154e49ed01be None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.765336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.778088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.778961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.779238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.779508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] PATH_INFO: `/v3/users/69ba94add49d4e52b955f73ba7282987` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.793725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] RBAC: Authorizing `identity:get_user(user_id=69ba94add49d4e52b955f73ba7282987)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:32.795233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:32.797009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 153/305] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/users/69ba94add49d4e52b955f73ba7282987 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:32.797758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.811426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49d86-5031-4ad1-b3dc-09f4cb5c2717 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.849210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.849898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.850212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.850500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.851235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:32.851543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:32.853583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:32.862463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 153/306] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:32.867445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.909464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda12fe-3389-40e1-8b94-68ea438802cf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:32.945149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:32.945849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:32.946161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:32.946436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] PATH_INFO: `/v3/groups` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:32.947120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:32.947827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:32.948555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:32.964479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 154/307] 10.222.0.61 () {60 vars in 1134 bytes} [Fri May 27 03:09:32 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:32.965574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:32.998340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2ace-f1f7-479a-98df-79ac5a343ca9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:33.031415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:33.051277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:33.053640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.054160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.054652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.056761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] RBAC: Adding query filter params (role.id=8a9b9fe946844e3fa9690c8965a1a86f, user.id=69ba94add49d4e52b955f73ba7282987, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:33.057307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:33.059477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:33.067965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 154/308] 10.222.0.61 () {56 vars in 1308 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/role_assignments?user.id=69ba94add49d4e52b955f73ba7282987&scope.system=all&role.id=8a9b9fe946844e3fa9690c8965a1a86f => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:33.103677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94dc02-e414-499e-b9d5-a5bbb492bf35 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:33.145369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389493ad-72e3-4981-a960-93670b9e3ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:33.146338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389493ad-72e3-4981-a960-93670b9e3ada None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.146621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389493ad-72e3-4981-a960-93670b9e3ada None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.146896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389493ad-72e3-4981-a960-93670b9e3ada None admin] PATH_INFO: `/v3/users/c114ff523de9439395bf7c77cbba3caf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.148343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389493ad-72e3-4981-a960-93670b9e3ada None admin] RBAC: Authorizing `identity:get_user(user_id=c114ff523de9439395bf7c77cbba3caf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:33.150552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389493ad-72e3-4981-a960-93670b9e3ada None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:33.152797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 155/309] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:32 2022] GET /identity/v3/users/c114ff523de9439395bf7c77cbba3caf => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:33.158789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:33.284654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bb8f6-89b8-4d20-ba04-dadd45abbbee None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:33.306388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabeb2c-9f32-4de7-ae7a-1961c9d7c5d8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.306701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabeb2c-9f32-4de7-ae7a-1961c9d7c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.306947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabeb2c-9f32-4de7-ae7a-1961c9d7c5d8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.309103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 156/310] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:33.314215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.314644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.315219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.329563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:33.330421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.330705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.330980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] PATH_INFO: `/v3/system/users/c114ff523de9439395bf7c77cbba3caf/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.332491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c114ff523de9439395bf7c77cbba3caf, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:33.333896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:33.336022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:33.343887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:33.345501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:33.347308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 155/311] 10.222.0.61 () {58 vars in 1334 bytes} [Fri May 27 03:09:33 2022] PUT /identity/v3/system/users/c114ff523de9439395bf7c77cbba3caf/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:33.433736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 157/312] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:33.458293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:33.585814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c7e80-d6be-4b7f-886c-81bd8defc994 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:33.623926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:33.624746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.625031 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.625306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.637280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:33.645177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:33.646109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:33.646913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 156/313] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:33.653097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:33.701467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:33.766536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de9995-509b-48d4-b5df-5a27bf2d9b3f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:33.802034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:33.802715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.802993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.803265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.804013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:33.804318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:33.805720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:33.814893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 158/314] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:33.820172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:33.890485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:33.929765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f94610-b81c-41d0-9c64-08548984b0d5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:33.965824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:33.966742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:33.967022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:33.967293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] PATH_INFO: `/v3/users/cbc998d5d42646ef9330fb70d5f347f7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:33.968500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] RBAC: Authorizing `identity:get_user(user_id=cbc998d5d42646ef9330fb70d5f347f7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:33.970459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:33.972792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 157/315] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:33 2022] GET /identity/v3/users/cbc998d5d42646ef9330fb70d5f347f7 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:33.983078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:34.100111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6009da-a803-4a15-8d0a-a08a39403358 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:34.114754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:34.136599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:34.137325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:34.137608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:34.137876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:34.208535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:34.210150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:34.321099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 159/316] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:34.326544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:34.448355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a46f07-fd7d-4be3-8985-96a7cd7bd061 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:34.474752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:34.483977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63b17a-d973-4712-9dad-d50415cdfda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:34.484859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b17a-d973-4712-9dad-d50415cdfda8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:34.485141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b17a-d973-4712-9dad-d50415cdfda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:34.485420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b17a-d973-4712-9dad-d50415cdfda8 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:34.486832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63b17a-d973-4712-9dad-d50415cdfda8 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:34.488512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63b17a-d973-4712-9dad-d50415cdfda8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:34.494075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 158/317] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:34 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:34.499239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:34.511379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:34.615739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52fc2-c1e0-43f0-9243-0a6920c2d0c3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:34.650669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:34.651328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:34.651609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:34.651877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:34.652699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] RBAC: Adding query filter params (role.id=8a9b9fe946844e3fa9690c8965a1a86f, scope.project.id=91205116ad304c9288bc0d5380b39f56, user.id=cbc998d5d42646ef9330fb70d5f347f7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:34.653005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:34.654489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81787a3-923b-4a49-adba-4cbaddadd365 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:34.660831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 160/318] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:09:34 2022] GET /identity/v3/role_assignments?user.id=cbc998d5d42646ef9330fb70d5f347f7&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=8a9b9fe946844e3fa9690c8965a1a86f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:35.479103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6a02-96ee-4457-91db-ab0b9b039e2a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.479662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6a02-96ee-4457-91db-ab0b9b039e2a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.479662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6a02-96ee-4457-91db-ab0b9b039e2a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.480027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52c3a-ee1d-42d4-93b9-ff2b0a807a6f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.480416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52c3a-ee1d-42d4-93b9-ff2b0a807a6f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.480649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52c3a-ee1d-42d4-93b9-ff2b0a807a6f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.481068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 159/319] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:35.482275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 161/320] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:35.486651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.487209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.487524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.488352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.488641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.488925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.509727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:35.509727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:35.512007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:35.513223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:35.601361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:35.606321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 160/321] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:35.618126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 162/322] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:35.630895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:35.635132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:35.755497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d83b0-2f7c-46e1-aeca-be718a5dac18 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:35.760456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5078-de84-4f19-bcc2-84e0b5ad34d2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:35.795841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:35.803901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90f33-192c-4f72-b664-d14360f9faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:35.804716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90f33-192c-4f72-b664-d14360f9faf1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.805000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90f33-192c-4f72-b664-d14360f9faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.805278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90f33-192c-4f72-b664-d14360f9faf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.806498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90f33-192c-4f72-b664-d14360f9faf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:35.808015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90f33-192c-4f72-b664-d14360f9faf1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:35.809726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685d864-54ab-485c-b6c5-49e86d3d1bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:35.809850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 163/323] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:35.811161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685d864-54ab-485c-b6c5-49e86d3d1bfd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.811636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685d864-54ab-485c-b6c5-49e86d3d1bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.812003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685d864-54ab-485c-b6c5-49e86d3d1bfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.813128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017a05-2a42-423a-80ba-3b0556993f28 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.813624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017a05-2a42-423a-80ba-3b0556993f28 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.814119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017a05-2a42-423a-80ba-3b0556993f28 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.815812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 164/324] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:35.816534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017a05-2a42-423a-80ba-3b0556993f28 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:35.825229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685d864-54ab-485c-b6c5-49e86d3d1bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e685d864-54ab-485c-b6c5-49e86d3d1bfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:35.833414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:35.834567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:35.835401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 161/325] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:35.836708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.836708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.837095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.856605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:35.858004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:35.888292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:35.938738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 162/326] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:35.939703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:35.954930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017a05-2a42-423a-80ba-3b0556993f28 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:35.994698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:35.995356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:35.995639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:35.995908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] PATH_INFO: `/v3/groups` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:35.996595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:35.998060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.022825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 165/327] 10.222.0.61 () {60 vars in 1134 bytes} [Fri May 27 03:09:35 2022] POST /identity/v3/groups => generated 226 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:36.022825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:36.081179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ca69-1167-4d20-a843-d7b208337134 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.110683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:36.143474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.144173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.144453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.144724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.145497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:36.145838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:36.147339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.160154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 163/328] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:36.167846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:36.180322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e672-7910-44c0-a947-02a4716a1c72 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.220073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:36.235355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.236437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.236712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.236939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.250968 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:36.261997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:36.262982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:36.263782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 166/329] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:36.268282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:36.321494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2915c-e92e-49d4-9343-fc4e5893ce90 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.371665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.371973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.372061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.372292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] PATH_INFO: `/v3/users/69ba94add49d4e52b955f73ba7282987` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.374472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] RBAC: Authorizing `identity:get_user(user_id=69ba94add49d4e52b955f73ba7282987)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:36.375113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.377234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 164/330] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:36 2022] GET /identity/v3/users/69ba94add49d4e52b955f73ba7282987 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:36.384728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:36.448451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd0008-0373-416e-8f97-17b6f7b88b54 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.451511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:36.505581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.509840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.509840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.509840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.509840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:36.510218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:36.511630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.525206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 167/331] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:36.531681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:36.542597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251dd17-ad6f-4045-9292-2c3e8ecae40f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.585669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.587069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.587498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.587962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] PATH_INFO: `/v3/system/users/69ba94add49d4e52b955f73ba7282987/roles/8a9b9fe946844e3fa9690c8965a1a86f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.590046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=69ba94add49d4e52b955f73ba7282987, role_id=8a9b9fe946844e3fa9690c8965a1a86f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:36.591966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.604721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 165/332] 10.222.0.61 () {58 vars in 1334 bytes} [Fri May 27 03:09:36 2022] PUT /identity/v3/system/users/69ba94add49d4e52b955f73ba7282987/roles/8a9b9fe946844e3fa9690c8965a1a86f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:36.615023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:36.681661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e672004-03f6-4490-a3a0-244e94fd474c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.725424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeecc5-e5da-43a3-b362-ce92466cfa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.726382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeecc5-e5da-43a3-b362-ce92466cfa6a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.727231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeecc5-e5da-43a3-b362-ce92466cfa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.727523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeecc5-e5da-43a3-b362-ce92466cfa6a None admin] PATH_INFO: `/v3/users/c114ff523de9439395bf7c77cbba3caf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.728997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeecc5-e5da-43a3-b362-ce92466cfa6a None admin] RBAC: Authorizing `identity:get_user(user_id=c114ff523de9439395bf7c77cbba3caf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:36.730628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eeecc5-e5da-43a3-b362-ce92466cfa6a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.732667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 168/333] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:36 2022] GET /identity/v3/users/c114ff523de9439395bf7c77cbba3caf => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:36.738730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:36.884551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79956e2-2b24-4118-a479-8a59a6b9a78b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:36.894966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:36.927391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:36.928112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:36.928303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:36.928555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:36.929571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] RBAC: Adding query filter params (role.id=ee525f9120064af5a37358b119bbedae, user.id=c114ff523de9439395bf7c77cbba3caf, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:36.930626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:36.932173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaf371-721c-46c5-90e9-a27f9c09f2cc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:36.947968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 166/334] 10.222.0.61 () {56 vars in 1308 bytes} [Fri May 27 03:09:36 2022] GET /identity/v3/role_assignments?user.id=c114ff523de9439395bf7c77cbba3caf&scope.system=all&role.id=ee525f9120064af5a37358b119bbedae => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:39.130867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d15dc4-5675-4221-9ce1-88ab616ca529 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.131909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d15dc4-5675-4221-9ce1-88ab616ca529 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.132397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d15dc4-5675-4221-9ce1-88ab616ca529 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.134859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 169/335] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:39.140988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.141886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.142407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.160939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:39.162518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:39.171656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7323bd-89d2-49bf-8ff1-7b7d3d414777 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.172270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7323bd-89d2-49bf-8ff1-7b7d3d414777 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.172764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7323bd-89d2-49bf-8ff1-7b7d3d414777 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.174396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 170/336] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:39.180555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.181075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.181522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.214114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:39.215403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:39.297614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 167/337] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:39.364610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:39.377176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 171/338] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:39.435517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:39.514335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:39.543714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:39.550851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653dc5-aed0-4999-b8dd-7d70a30a1298 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:39.608415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:39.609619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.610101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.610566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.639841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:39.648288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfb4a0-2970-4997-a5df-70ea9ff91de2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:39.660983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:39.662221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:39.663356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:39.666709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 168/339] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:39.673251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:39.769911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:39.771040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.771638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.772080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.803134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:39.811949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:39.813385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:39.818656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:39.821401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 172/340] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:39.827683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:39.873494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5322ac-d52e-451f-be82-8728a8dabb48 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:39.940483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:39.941175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:39.941453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:39.941728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:39.942805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:39.943113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:39.944688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:39.961843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 169/341] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:39.968019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:40.003678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:40.076903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342546d-b113-44ec-8df2-70ecacab1cde None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:40.082436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:40.157330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:40.158225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.158513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.158786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.160952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:40.161264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:40.162882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:40.182106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 173/342] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:40.187851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:40.195868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac2332-9bb3-4057-bf6d-5fc51cd801ba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:40.258522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc605d2-6cc7-4190-88cb-43aa26ce7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:40.259198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc605d2-6cc7-4190-88cb-43aa26ce7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.259480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc605d2-6cc7-4190-88cb-43aa26ce7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.259964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc605d2-6cc7-4190-88cb-43aa26ce7ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.455418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4410de-9f11-46ed-9d16-18d30785bc37 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:40.458059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc605d2-6cc7-4190-88cb-43aa26ce7ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:40.459762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc605d2-6cc7-4190-88cb-43aa26ce7ac9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:40.505250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:40.544049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7910e-3495-4fa3-96ae-6f8e7d1442a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:40.544721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7910e-3495-4fa3-96ae-6f8e7d1442a9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.545001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7910e-3495-4fa3-96ae-6f8e7d1442a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.545275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7910e-3495-4fa3-96ae-6f8e7d1442a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.603805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:40.621256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 170/343] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:40.622861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89866413-f71b-4d1a-8aa8-663044933c31 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.622977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89866413-f71b-4d1a-8aa8-663044933c31 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.623323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89866413-f71b-4d1a-8aa8-663044933c31 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.624818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 171/344] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:40.626011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4a57b-0450-4ce1-8075-f4de8f1efcb8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.626292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4a57b-0450-4ce1-8075-f4de8f1efcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.626745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4a57b-0450-4ce1-8075-f4de8f1efcb8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.628749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 172/345] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:40.629737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4a57b-0450-4ce1-8075-f4de8f1efcb8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:40.658507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7910e-3495-4fa3-96ae-6f8e7d1442a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:40.660359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7910e-3495-4fa3-96ae-6f8e7d1442a9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:40.770091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4a57b-0450-4ce1-8075-f4de8f1efcb8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:40.803147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:40.807158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 174/346] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:40.808885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17d0b-4a9a-4215-804f-f1a657894ff5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.809223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17d0b-4a9a-4215-804f-f1a657894ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.809516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17d0b-4a9a-4215-804f-f1a657894ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.831304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-deb17d0b-4a9a-4215-804f-f1a657894ff5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:40.832510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-deb17d0b-4a9a-4215-804f-f1a657894ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:40.834023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c0fa9-b971-4449-9d89-0423e0093790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:40.835340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0fa9-b971-4449-9d89-0423e0093790 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.835653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0fa9-b971-4449-9d89-0423e0093790 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.836470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c0fa9-b971-4449-9d89-0423e0093790 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.839557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0fa9-b971-4449-9d89-0423e0093790 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:40.841225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c0fa9-b971-4449-9d89-0423e0093790 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:40.843258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 173/347] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:40 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:40.844764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.845502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.845988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.867361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:40.869034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:40.919218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:40.933812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 175/348] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:40.935349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7a59-3872-49a9-ab26-8895ac75cba9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:40.935638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7a59-3872-49a9-ab26-8895ac75cba9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:40.935961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7a59-3872-49a9-ab26-8895ac75cba9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:40.937289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 176/349] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:40.938107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7a59-3872-49a9-ab26-8895ac75cba9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:40.977463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 174/350] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:40.978716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.095483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7a59-3872-49a9-ab26-8895ac75cba9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.111476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0d90e-9cb4-46cc-8e05-863a85f56e55 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.140667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:41.145035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1ace4-ff6e-4de0-8c14-662d3a209f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.146624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ace4-ff6e-4de0-8c14-662d3a209f9d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.146624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ace4-ff6e-4de0-8c14-662d3a209f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.146624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ace4-ff6e-4de0-8c14-662d3a209f9d None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.148257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ace4-ff6e-4de0-8c14-662d3a209f9d None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:41.150771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ace4-ff6e-4de0-8c14-662d3a209f9d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:41.153241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 177/351] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:40 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:41.154460 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.154746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.155246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.173163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.174068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.174351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.174624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.175330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:41.177025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:41.183424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:41.185140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:41.187498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 175/352] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:40 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:41.189336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.284450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:41.300014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 178/353] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:41.300687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.334692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12998642-ef4b-4a76-aa7a-b6218820d660 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.382113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.382883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.383285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.383565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.395906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:41.405179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:41.406392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:41.407274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 176/354] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:41.407980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.438539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a600d23-bfc4-4e9c-bee9-e20e12fb107d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.472585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:41.491508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.492380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.492659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.492933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.506291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:41.515092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:41.516205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:41.517128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:41.519103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 179/355] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:41.520045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.553549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89116cea-317f-45ef-a663-7d352ac6a430 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.585502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:41.597774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.598674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.599836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.599836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.602076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:41.603798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:41.607895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 177/356] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:41.608028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.661632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df1da-9209-4c32-855f-3fdc8212c6b0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.709386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.710489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.711459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.711740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.713511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=8f1ef364fa7945739dc7d830165cce32) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:41.713511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:41.714448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:41.722406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 180/357] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:41.724062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.739320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef79a9-afb1-4b9d-99d1-33dfe97a9b16 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.751241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:41.790673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637a3b-4d37-4aa3-91ee-beb2e4adf539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.791508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637a3b-4d37-4aa3-91ee-beb2e4adf539 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.791791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637a3b-4d37-4aa3-91ee-beb2e4adf539 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.792062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637a3b-4d37-4aa3-91ee-beb2e4adf539 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.805889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637a3b-4d37-4aa3-91ee-beb2e4adf539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2f637a3b-4d37-4aa3-91ee-beb2e4adf539 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:41.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:41.817401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:41.818290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 178/358] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:41.823450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f526b-7686-4239-82ae-86ff0b9de55e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.823724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f526b-7686-4239-82ae-86ff0b9de55e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.824035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f526b-7686-4239-82ae-86ff0b9de55e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.825733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 179/359] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:41.829223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f526b-7686-4239-82ae-86ff0b9de55e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:41.898844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758a2d4-9139-4278-860a-d54de496d8db None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:41.924290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:41.953061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:41.953267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:41.953523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:41.953798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:41.954656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:41.954962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:41.957541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:41.967381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 181/360] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:41.968245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.002524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f526b-7686-4239-82ae-86ff0b9de55e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.051327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.052467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.053022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.053585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.054647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:42.055173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:42.056976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:42.067664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 180/361] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:42.068359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.107075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb446c49-f20a-42c5-af37-42e269f2d674 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.127952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:42.169539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.169539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.169539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.169539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.170041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=8f1ef364fa7945739dc7d830165cce32) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:42.170041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:42.171492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce7b17-f664-4075-9849-0842d48a3741 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:42.179230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 182/362] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:41 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=ee525f9120064af5a37358b119bbedae => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:42.181604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.181895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.182224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.214098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:42.216137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:42.222242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bd7c5-aa1c-4595-9906-ee2953a444e5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.263503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.264197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.264477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.264750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.265515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:42.265824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:42.268359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:42.279252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 181/363] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:42.280145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.282007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:42.313443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 183/364] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:42.314688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.420864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:42.439775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe81fe-d1b8-472f-97e2-a38b782e5313 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.466941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa95191-306d-4764-bcbe-5f77bcd13438 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.500235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.501461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.501896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.502365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] PATH_INFO: `/v3/users/69ba94add49d4e52b955f73ba7282987` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.503832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] RBAC: Authorizing `identity:get_user(user_id=69ba94add49d4e52b955f73ba7282987)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:42.505530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:42.508342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 182/365] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/users/69ba94add49d4e52b955f73ba7282987 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:42.509900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.526647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.527700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.527986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.528261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.579742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:42.614501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:42.616440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:42.644390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c14f4-660e-48b9-93a5-7123cf7f1e45 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.691171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.692811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.693464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.694028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.743319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:42.745837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 184/366] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:42.746605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.796155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:42.797646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:42.850431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:42.888723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e1d4f-1c79-4e08-b127-86c6fafa35f0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:42.933029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 183/367] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:42.938920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:42.939085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:42.940536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:42.941049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:42.941627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:42.957416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:42.968766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:42.969731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:42.970841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:42.972154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 185/368] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:42.974110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.029232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:43.099245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333590-1ca7-4eb2-b575-288fe41133c1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.144867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.145923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.146174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.146468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.147381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] RBAC: Adding query filter params (role.id=8a9b9fe946844e3fa9690c8965a1a86f, user.id=69ba94add49d4e52b955f73ba7282987, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:43.147723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.149371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.160009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871348f5-e7cf-4543-ae4f-a1b73ba50358 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.169585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 184/369] 10.222.0.61 () {56 vars in 1308 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/role_assignments?user.id=69ba94add49d4e52b955f73ba7282987&scope.system=all&role.id=8a9b9fe946844e3fa9690c8965a1a86f => generated 510 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:43.170669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.217586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.219632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.219918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.220462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.223887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.225392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.227632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 186/370] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:42 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:43.228593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.231636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:43.382139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07679-aff0-4fd6-b640-f753c9b1fc2c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.439078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.439779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.440066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.440459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.440753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b28d2-3b94-4f99-9f2a-857d2b6c0f8d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.441298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:43.441752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.443602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.462981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 187/371] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:43.468709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:43.472801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.491470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.492792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.493284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.493769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.495279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.497691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.504805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 185/372] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:43.506011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.567617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:43.614922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb610b7-1f5e-4fb9-a94a-34a091ef525e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.621344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b4ee7-aaf8-4d47-811e-60995d4902d6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.655528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.656991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.657656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.658071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.659616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.662595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.664469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 188/373] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:43.664833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.669876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.670915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.671426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.672126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.770218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:43.798009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.800948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.809780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab3ba9-d92f-4851-8a62-26a72c79a819 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:43.852884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:43.862855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:43.864575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:43.865077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:43.866045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:43.868367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:43.871052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:43.874091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 189/374] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:43.875106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:43.949183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 186/375] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:43.954303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:44.009029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b3fa0-d40f-446f-b0b9-4a879682361a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:44.055947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:44.056948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.058097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.058582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.059622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=91205116ad304c9288bc0d5380b39f56) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:44.060625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:44.062325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:44.070777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 190/376] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:44.072270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:44.076152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:44.116998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea193784-f5df-4164-9139-00694a01da27 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:44.166970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:44.176663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:44.177445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.177733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.178215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.179236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=91205116ad304c9288bc0d5380b39f56) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:44.179652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:44.182432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:44.190216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 187/377] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:43 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=ee525f9120064af5a37358b119bbedae => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:44.222712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ea72e-c77b-4d0a-be38-78fd7086e0e0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:44.264494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:44.265704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.266178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.266606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] PATH_INFO: `/v3/projects/3b90443493d84a01a8c521f600d4b6fc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.268178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] RBAC: Authorizing `identity:get_project(project_id=3b90443493d84a01a8c521f600d4b6fc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:44.270014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:44.272037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 191/378] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:44 2022] GET /identity/v3/projects/3b90443493d84a01a8c521f600d4b6fc => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:44.278647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:44.441198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb22ff-272c-4d12-ac71-b525382e608c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:44.495516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f63266-5be3-42a4-8372-4c6d0eac4243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:44.496421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f63266-5be3-42a4-8372-4c6d0eac4243 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.496706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f63266-5be3-42a4-8372-4c6d0eac4243 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.497011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f63266-5be3-42a4-8372-4c6d0eac4243 None admin] PATH_INFO: `/v3/groups/de0564dfe0964348b848a07fd4a1bbdf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.505997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f63266-5be3-42a4-8372-4c6d0eac4243 None admin] RBAC: Authorizing `identity:get_group(group_id=de0564dfe0964348b848a07fd4a1bbdf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:44.509698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f63266-5be3-42a4-8372-4c6d0eac4243 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:44.509698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 188/379] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:44 2022] GET /identity/v3/groups/de0564dfe0964348b848a07fd4a1bbdf => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:44.516086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:44.567909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517ad2-2724-415c-b0ae-bcabbe7f3f53 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.568235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517ad2-2724-415c-b0ae-bcabbe7f3f53 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.568542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517ad2-2724-415c-b0ae-bcabbe7f3f53 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.570860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 189/380] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:44.577223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.577515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.578098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.613126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:44.614356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:44.640277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:44.715613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645545dc-c211-4130-90b2-ae50aaac8280 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:44.749992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:44.754843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 190/381] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:44.763779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:44.764775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.765243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.765696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:44.766761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] RBAC: Adding query filter params (group.id=de0564dfe0964348b848a07fd4a1bbdf, role.id=d0122fde930842079d42ce76139767e2, scope.project.id=3b90443493d84a01a8c521f600d4b6fc) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:44.767278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:44.768936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:44.780412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 192/382] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:44 2022] GET /identity/v3/role_assignments?group.id=de0564dfe0964348b848a07fd4a1bbdf&scope.project.id=3b90443493d84a01a8c521f600d4b6fc&role.id=d0122fde930842079d42ce76139767e2 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:44.781094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:44.946848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422ec6b-337c-4435-9f41-deea9c7fad20 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:44.991834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933ac73-b759-4428-855c-ecf8c3456429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:44.993170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933ac73-b759-4428-855c-ecf8c3456429 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:44.993475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933ac73-b759-4428-855c-ecf8c3456429 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:44.993764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933ac73-b759-4428-855c-ecf8c3456429 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.009998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933ac73-b759-4428-855c-ecf8c3456429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9933ac73-b759-4428-855c-ecf8c3456429 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:45.027929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:45.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:45.029730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 191/383] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:45.037059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:45.193613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d9fe-2814-4888-bcc2-dab4c448e137 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:45.220530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d46c8-bdbd-49c9-9dd9-289fbe585c74 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.220894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d46c8-bdbd-49c9-9dd9-289fbe585c74 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.221198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d46c8-bdbd-49c9-9dd9-289fbe585c74 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.231558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 192/384] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:45.237638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.238557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.239559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.240353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:45.241572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.243559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.244035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.244982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:45.245829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:45.248306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:45.254989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:45.269943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 193/385] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:45.278005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:45.278005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:45.279604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:45.355946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:45.391923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776095-1c4d-4d82-8bda-2cde82b8c4ec None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:45.432278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:45.433497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.433933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.434390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.435804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:45.437411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:45.439596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 194/386] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:45 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:45.446097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 193/387] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:45.447647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:45.515062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:45.609500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f68d9-4293-4162-ac10-d0b2b82e205a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:45.642704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:45.654332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:45.655325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.655608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.656009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.659668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:45.661420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:45.663359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 195/388] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:45 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:45.669997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:45.778124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f09e7-1564-49af-8ed9-01eafcb20413 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:45.789863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857ce0-4890-4663-8289-7b166a41cefc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:45.833660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:45.834807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.835120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.835518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32/groups/57be9a8587a547fdb5dcc244a9279588/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.838202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ef364fa7945739dc7d830165cce32, group_id=57be9a8587a547fdb5dcc244a9279588, role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:45.839866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:45.857257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 196/389] 10.222.0.61 () {58 vars in 1442 bytes} [Fri May 27 03:09:45 2022] PUT /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32/groups/57be9a8587a547fdb5dcc244a9279588/roles/625fb35ccd424520a9a0766b1d193e60 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:45.892771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:45.893594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:45.893879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:45.894180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:45.901466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:45.916976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:45.924860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:45.925764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:45.926626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 194/390] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:45.932834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:46.052288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:46.104590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64ad6-2b5d-4d2d-ac45-1a5ee846adf7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:46.144214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:46.144913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:46.145194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:46.145468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:46.146257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:46.146560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:46.148494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:46.158107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 197/391] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:46.165363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:46.277801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b791b9-233e-47e1-9c64-89a11955a71f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:46.322770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:46.323555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:46.323833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:46.324105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:46.325340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:46.326852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:46.328815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 195/392] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:46 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:46.334307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:46.449546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490fbb-d1c4-4f1f-89a8-9a0b252f3f56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:46.467855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:46.505687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d2315-3e43-4c5a-a715-eaf4e11be316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:46.513375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d2315-3e43-4c5a-a715-eaf4e11be316 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:46.513684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d2315-3e43-4c5a-a715-eaf4e11be316 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:46.513934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d2315-3e43-4c5a-a715-eaf4e11be316 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:46.518852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d2315-3e43-4c5a-a715-eaf4e11be316 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:46.520737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d2315-3e43-4c5a-a715-eaf4e11be316 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:46.523011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 198/393] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:46 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:46.529599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:46.612022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:46.656535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9ae5e-c017-42e9-ae12-f4f67805c552 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:46.699935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc71f7-0acc-4de1-82d0-e7771a545f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:46.701211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc71f7-0acc-4de1-82d0-e7771a545f9b None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:46.701713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc71f7-0acc-4de1-82d0-e7771a545f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:46.702272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc71f7-0acc-4de1-82d0-e7771a545f9b None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32/groups/57be9a8587a547fdb5dcc244a9279588/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:46.707284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc71f7-0acc-4de1-82d0-e7771a545f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ef364fa7945739dc7d830165cce32, group_id=57be9a8587a547fdb5dcc244a9279588, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:46.708985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc71f7-0acc-4de1-82d0-e7771a545f9b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:46.725592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 196/394] 10.222.0.61 () {58 vars in 1442 bytes} [Fri May 27 03:09:46 2022] PUT /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32/groups/57be9a8587a547fdb5dcc244a9279588/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:47.006874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40cef2-d868-4b29-871c-8583810bf648 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.008247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40cef2-d868-4b29-871c-8583810bf648 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.008786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40cef2-d868-4b29-871c-8583810bf648 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.011152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 199/395] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:47.016810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.017392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.017815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.022330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60ba9-e557-4e81-8769-3a83e80d61f6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.022738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60ba9-e557-4e81-8769-3a83e80d61f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.023694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60ba9-e557-4e81-8769-3a83e80d61f6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.025851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 200/396] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:47.032296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.032643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.032884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.040730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:47.042417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:47.057996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:47.059282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:47.180723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 197/397] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:47.184182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 201/398] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:47.214930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:47.225311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:47.302670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:47.357836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949006e-5c2c-4ac5-9237-8bb93090b0c8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:47.416668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:47.418033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.419297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.420323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.422991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0972-eb21-4faf-b016-9ec939a4c804 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:47.443767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:47.454724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:47.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:47.456554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:47.463283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:47.472798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 198/399] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:47.474049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:47.503921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:47.504817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.505048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.505302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.526955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:47.535958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:47.537034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:47.538001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 202/400] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:47.544189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:47.610971 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26617e51-5bb2-41bc-8235-465c9ae8c1a6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:47.626943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:47.655910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:47.656992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.657545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.658159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.659250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:47.659894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:47.661855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:47.672557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 199/401] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:47.679153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:47.764939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959c325-ee1a-4e2f-be08-828d45e4ce33 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:47.811350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:47.812627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.813094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.813805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.815253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:47.816123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:47.818543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646e58d-5598-4f20-8354-1983b14d7783 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:47.834011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 203/402] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:47.836205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb556-f2bf-41be-a2c2-6d6d87186b60 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.836679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb556-f2bf-41be-a2c2-6d6d87186b60 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.837188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb556-f2bf-41be-a2c2-6d6d87186b60 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.840245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 204/403] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:47.841614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f000f-9b30-4cf6-a6c4-9caae2250add None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:47.842036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb556-f2bf-41be-a2c2-6d6d87186b60 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:47.885284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0ed7c-8d3d-4194-9c2f-9970fa0f3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:47.886240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ed7c-8d3d-4194-9c2f-9970fa0f3943 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.886639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ed7c-8d3d-4194-9c2f-9970fa0f3943 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.886982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ed7c-8d3d-4194-9c2f-9970fa0f3943 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.888456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0ed7c-8d3d-4194-9c2f-9970fa0f3943 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:47.890574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0ed7c-8d3d-4194-9c2f-9970fa0f3943 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:47.892304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 200/404] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:47 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:47.893590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:47.893943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:47.894468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:47.896306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:47.919161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:47.921073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:47.977333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:47.995458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb556-f2bf-41be-a2c2-6d6d87186b60 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.025481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 201/405] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:48.026825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.038603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.039490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.039859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.040139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.041645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.043371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.045750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 205/406] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:47 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:48.051926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.139411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e08f76-916a-4b5f-b176-af2a4c0c36f7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.175904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993fce-20fe-49cb-9388-4fd0b5617602 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.177685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.178387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:48.179739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.180498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.181128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.183341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.185573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.188010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 202/407] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:48 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:48.189303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.219643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.220781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.221081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.221352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.222704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.224286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.234414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 206/408] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:48 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:48.234414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.245712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:48.317656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396c88-539e-46e4-a738-a8c185f719e9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.356573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.358074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.358599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.359095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.360936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13bb30-59f1-4069-b218-f5d341e2b275 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.372743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:48.380991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:48.381922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:48.382803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:48.385524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 203/409] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:48.386660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.401135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.402511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.402655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.402978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56/groups/57be9a8587a547fdb5dcc244a9279588/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.405292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=91205116ad304c9288bc0d5380b39f56, group_id=57be9a8587a547fdb5dcc244a9279588, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.406863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.426508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 207/410] 10.222.0.61 () {58 vars in 1442 bytes} [Fri May 27 03:09:48 2022] PUT /identity/v3/projects/91205116ad304c9288bc0d5380b39f56/groups/57be9a8587a547fdb5dcc244a9279588/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:48.428119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.474359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:48.526290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:48.530498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5dacd-1450-438e-8c65-9857a10c6e37 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.585569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acee185-7145-4bef-9c08-98dfcba48c85 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.602810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.603976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.604409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.604974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56/groups/57be9a8587a547fdb5dcc244a9279588/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.610952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] RBAC: Authorizing `identity:create_grant(project_id=91205116ad304c9288bc0d5380b39f56, group_id=57be9a8587a547fdb5dcc244a9279588, role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.642018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.642018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.642018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.642018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.642708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:48.642708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.642708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.647094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 204/411] 10.222.0.61 () {58 vars in 1442 bytes} [Fri May 27 03:09:48 2022] PUT /identity/v3/projects/91205116ad304c9288bc0d5380b39f56/groups/57be9a8587a547fdb5dcc244a9279588/roles/625fb35ccd424520a9a0766b1d193e60 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:48.655949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 208/412] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:48.662381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:48.833767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42037-bd81-4d8d-82c8-160e4f7afa19 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:48.883241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:48.884686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:48.885201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:48.885677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] PATH_INFO: `/v3/groups/de0564dfe0964348b848a07fd4a1bbdf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:48.887147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] RBAC: Authorizing `identity:get_group(group_id=de0564dfe0964348b848a07fd4a1bbdf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:48.888948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:48.891151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 205/413] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:48 2022] GET /identity/v3/groups/de0564dfe0964348b848a07fd4a1bbdf => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:48.896719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:49.010544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:49.018685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890286f8-bdeb-4ae2-8ca7-8128d6b129ad None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:49.056530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757ab7-b968-4c58-8bac-7e4cfe842d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:49.057411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757ab7-b968-4c58-8bac-7e4cfe842d17 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.057694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757ab7-b968-4c58-8bac-7e4cfe842d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.057984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757ab7-b968-4c58-8bac-7e4cfe842d17 None admin] PATH_INFO: `/v3/projects/3b90443493d84a01a8c521f600d4b6fc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.059256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757ab7-b968-4c58-8bac-7e4cfe842d17 None admin] RBAC: Authorizing `identity:get_project(project_id=3b90443493d84a01a8c521f600d4b6fc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:49.060713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757ab7-b968-4c58-8bac-7e4cfe842d17 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:49.062470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 209/414] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:48 2022] GET /identity/v3/projects/3b90443493d84a01a8c521f600d4b6fc => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:49.068225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:49.110357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d554c7-b4d3-4313-8b8e-e499ab8334f3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.110678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d554c7-b4d3-4313-8b8e-e499ab8334f3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.110922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d554c7-b4d3-4313-8b8e-e499ab8334f3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.112628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 210/415] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:49.123848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.124276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.124663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.128452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:49.161417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:49.162789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:49.277160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398e5f4-7e24-4dcf-95ae-83c9f49fc5bc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:49.323895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 211/416] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:49.339762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:49.340702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.341033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.341316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] PATH_INFO: `/v3/projects/3b90443493d84a01a8c521f600d4b6fc/groups/de0564dfe0964348b848a07fd4a1bbdf/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.343644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b90443493d84a01a8c521f600d4b6fc, group_id=de0564dfe0964348b848a07fd4a1bbdf, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:49.345418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:49.364281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 206/417] 10.222.0.61 () {58 vars in 1442 bytes} [Fri May 27 03:09:49 2022] PUT /identity/v3/projects/3b90443493d84a01a8c521f600d4b6fc/groups/de0564dfe0964348b848a07fd4a1bbdf/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:09:49.368939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:49.487564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:49.502459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5dcc-7340-432a-9522-e6b70525f454 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:49.544050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4421ea-a2cd-4b02-8b87-643b0236f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:49.544802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4421ea-a2cd-4b02-8b87-643b0236f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.545154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4421ea-a2cd-4b02-8b87-643b0236f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.545436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4421ea-a2cd-4b02-8b87-643b0236f5f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.558924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4421ea-a2cd-4b02-8b87-643b0236f5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ac4421ea-a2cd-4b02-8b87-643b0236f5f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:49.567548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:49.568540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:49.569350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 212/418] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:49.575812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:49.688622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:49.695118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74e36b-b897-47fd-b6cd-154362749780 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.695405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74e36b-b897-47fd-b6cd-154362749780 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.696211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74e36b-b897-47fd-b6cd-154362749780 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.698248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 213/419] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:49.705367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.706073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.706581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.707628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c6636-ff98-4a81-afa9-22c8c20490c4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:49.727768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:49.729334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:49.763891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:49.764198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:49.764283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:49.764649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:49.765405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:49.765706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:49.767167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:49.783005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 207/420] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:49.790393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:49.868413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 214/421] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:49.954912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:49.970183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f4c0f-ebbd-42b7-bfb1-2d925e0e2389 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.005698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.006654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.006950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.007327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.031409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:50.087340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:50.088883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:50.188636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:50.206885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 208/422] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:50.213392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:50.227941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e576c97-24ad-4f03-aa35-b7e0c30cf964 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.294398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:50.305263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.306372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.306795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.307210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.327535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:50.334270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c97a-88e0-41a2-bd2f-64e418ff9276 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:50.343552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:50.344528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:50.345635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 215/423] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:50.357015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:50.423629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.424546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.424830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.425106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.427071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:50.428608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:50.438028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 209/424] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:50 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:50.442501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:50.513246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc7d58-9955-4858-ae8e-5adb321e82aa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.554773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.555772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.556060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.556342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.557429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:50.557704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:50.559138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:50.569509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 216/425] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:50.576061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:50.580446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:50.648740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa712-83f8-4a25-9ab7-10fd0839c78e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.668667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:50.691094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.692064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.692784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.693469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.695355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:50.697226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:50.699186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 210/426] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:50 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:50.708229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:50.779369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2ac57-8159-430f-92cd-11e56674262b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.819282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.820338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.820828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.821306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.927267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:50.928517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf84b5-c6e9-41f5-8e0c-e65ec7c6c0e2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:50.928731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:50.945012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:50.967456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:50.968536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:50.969038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:50.969521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:50.970907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=8f1ef364fa7945739dc7d830165cce32) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:50.971446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:50.973128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:50.981052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 211/427] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:50 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:51.118875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 217/428] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:09:51.124981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.187770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:51.252573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552376f5-3563-4740-91a0-9fdc53eee412 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:51.292596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ef673-6a9b-4aff-8b8e-af01fbf74a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:51.293892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef673-6a9b-4aff-8b8e-af01fbf74a80 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.294449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef673-6a9b-4aff-8b8e-af01fbf74a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.294924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef673-6a9b-4aff-8b8e-af01fbf74a80 None admin] PATH_INFO: `/v3/projects/8f1ef364fa7945739dc7d830165cce32` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.296389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ef673-6a9b-4aff-8b8e-af01fbf74a80 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1ef364fa7945739dc7d830165cce32)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:51.298233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ef673-6a9b-4aff-8b8e-af01fbf74a80 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:51.300555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 212/429] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/projects/8f1ef364fa7945739dc7d830165cce32 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:51.306967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.409879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585144-2ff9-4614-99a6-59e5a58fc112 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.410249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585144-2ff9-4614-99a6-59e5a58fc112 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.410555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585144-2ff9-4614-99a6-59e5a58fc112 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.412273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 213/430] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:51.418886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8151-8e85-4675-b2dc-d3379066ced6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.419233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8151-8e85-4675-b2dc-d3379066ced6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.419504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8151-8e85-4675-b2dc-d3379066ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.450258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffc84a-8cf1-4425-a499-466744af7443 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:51.451065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4abb8151-8e85-4675-b2dc-d3379066ced6 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:51.452290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4abb8151-8e85-4675-b2dc-d3379066ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:51.482392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:51.500962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:51.502171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.502461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.502798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.504778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:51.507500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:51.510064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 218/431] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:51.516998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.570588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 214/432] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:51.575541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e63e1-74b4-47ab-a376-c35a8af3f825 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.576093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e63e1-74b4-47ab-a376-c35a8af3f825 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.577107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e63e1-74b4-47ab-a376-c35a8af3f825 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.579721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 215/433] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:51.584673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.584917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.585257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.608056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:51.609620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:51.648717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892e3eb-484d-4761-a699-8d330c1e1d6f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:51.665506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:51.692593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:51.693374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.693711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.693711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.694816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=8f1ef364fa7945739dc7d830165cce32) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:51.695155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:51.696647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:51.701195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 216/434] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:51.702743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.713550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 219/435] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=8f1ef364fa7945739dc7d830165cce32&role.id=ee525f9120064af5a37358b119bbedae => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:51.727748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.779539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:51.836336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9df66-28ca-461f-8088-355ba936c8d6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:51.864484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863afb-c86a-470e-a2e5-452c4f129386 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:51.879663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:51.880549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.881061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.881562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.894781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:51.904122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:51.905132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:09:51.906073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:51.909047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 217/436] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:51.916486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.929707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:51.930572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:51.930857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:51.931913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:51.948792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:51.957934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:51.963407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:51.965464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 220/437] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:51.968561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:51.977288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.056298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a39f7d-67e4-4a80-9a2a-0ff1e2b7750b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.099194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.099194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.099194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.099194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.099956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:52.100146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.101773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.112358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 218/438] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:52.119983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.138335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.148516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640860b0-9053-48c8-9538-495976ed3ca3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.202934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.203701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.204022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.204315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.205196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:52.205568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.207274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.222345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 221/439] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:52.229046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.270290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.280326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac27df3-d668-496b-bafb-db157b245818 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.331661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0ab4-257c-42eb-b8cd-98fbab493de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.332274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0ab4-257c-42eb-b8cd-98fbab493de1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.332571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0ab4-257c-42eb-b8cd-98fbab493de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.332873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0ab4-257c-42eb-b8cd-98fbab493de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.388520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918995-e04b-43b2-9f6d-fd465441dea1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.432039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cfb4f-9a9e-4720-8635-b6e01078c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.433290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cfb4f-9a9e-4720-8635-b6e01078c3da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.433290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cfb4f-9a9e-4720-8635-b6e01078c3da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.433576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cfb4f-9a9e-4720-8635-b6e01078c3da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.437728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d0ab4-257c-42eb-b8cd-98fbab493de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.439582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d0ab4-257c-42eb-b8cd-98fbab493de1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.475179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.525118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cfb4f-9a9e-4720-8635-b6e01078c3da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.526659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cfb4f-9a9e-4720-8635-b6e01078c3da None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.557729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.566154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 219/440] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:52.567872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b914-60ca-47ec-aac3-90439b750c1e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.568282 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b914-60ca-47ec-aac3-90439b750c1e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.568533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b914-60ca-47ec-aac3-90439b750c1e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.570630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 220/441] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:52.571375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b914-60ca-47ec-aac3-90439b750c1e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.641062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 222/442] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:09:52.642362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.642635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.643387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.660865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:52.662090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:52.684516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b914-60ca-47ec-aac3-90439b750c1e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.719146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.726452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.727952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.727952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.727952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.729288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.731462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.734622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 221/443] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:52.735997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.742219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 223/444] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:52.742219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.815833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:52.858369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778593-2226-46ad-9978-a4e5c84633d3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.860845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732b4c3-58ec-4d66-a94e-8854483c1d9f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:52.896882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.898210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.898515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.898787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.899887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:52.900013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.900745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:52.901022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:52.901291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] PATH_INFO: `/v3/projects/91205116ad304c9288bc0d5380b39f56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:52.901378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.902493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] RBAC: Authorizing `identity:get_project(project_id=91205116ad304c9288bc0d5380b39f56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:52.903058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 224/445] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:52.903971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.907386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:52.909524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 222/446] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/projects/91205116ad304c9288bc0d5380b39f56 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:52.910309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:52.975102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:53.019142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db339a7-7595-4e32-988b-5b676ce33462 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.026368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936714ad-065a-47ad-8fc5-7f6b957f1099 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.057356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.058053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.058358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.058669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.059444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=ee525f9120064af5a37358b119bbedae, scope.project.id=91205116ad304c9288bc0d5380b39f56) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:53.059757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:53.061208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:53.064405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.064645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:53.065127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.065408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.065693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.068382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 223/447] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=ee525f9120064af5a37358b119bbedae => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:53.072240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:53.079885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:53.089209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:53.091130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:53.092685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 225/448] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:53.097008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:53.207692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b6fc8-81d3-4707-af0f-8c9735e02a65 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.244734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b502ab-928d-4d9d-8831-fcd4a400e646 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.254732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.256533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.257098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.257718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] PATH_INFO: `/v3/groups/57be9a8587a547fdb5dcc244a9279588` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.259482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] RBAC: Authorizing `identity:get_group(group_id=57be9a8587a547fdb5dcc244a9279588)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:53.261488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:53.263545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 224/449] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:53 2022] GET /identity/v3/groups/57be9a8587a547fdb5dcc244a9279588 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:53.266234 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:53.270824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:53.295200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.296253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.296540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.296874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.298132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:53.298456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:53.299866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:53.313521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 226/450] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:09:53.319439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:53.362041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:53.408287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604933a-e6e6-410f-b293-fe12a5b62676 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.455740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed8fc2-2509-446d-a6b7-143886900d35 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.459380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.460609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.460796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.461183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.461910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] RBAC: Adding query filter params (group.id=57be9a8587a547fdb5dcc244a9279588, role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=91205116ad304c9288bc0d5380b39f56) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:53.462294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:53.464243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:53.471250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 225/451] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:53 2022] GET /identity/v3/role_assignments?group.id=57be9a8587a547fdb5dcc244a9279588&scope.project.id=91205116ad304c9288bc0d5380b39f56&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:53.501458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.502203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.502497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.502773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.564563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:53.591429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:53.592922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:53.708041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 227/452] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:09:53.715100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:53.837503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed2494-42bf-47c2-b361-2b698a9908bb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:53.870148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:53.875499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:53.876646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:53.877111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:53.877430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] PATH_INFO: `/v3/projects/3b90443493d84a01a8c521f600d4b6fc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:53.879109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] RBAC: Authorizing `identity:get_project(project_id=3b90443493d84a01a8c521f600d4b6fc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:53.880885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:53.885123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 226/453] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:09:53 2022] GET /identity/v3/projects/3b90443493d84a01a8c521f600d4b6fc => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:53.892702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:53.979275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:54.004978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18c0-c51a-4796-8224-9a063da10c69 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:54.044121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a424-9559-4c3b-ab72-94172ceacc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:54.044999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a424-9559-4c3b-ab72-94172ceacc45 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:54.045285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a424-9559-4c3b-ab72-94172ceacc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:54.045563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a424-9559-4c3b-ab72-94172ceacc45 None admin] PATH_INFO: `/v3/groups/de0564dfe0964348b848a07fd4a1bbdf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:54.046801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a424-9559-4c3b-ab72-94172ceacc45 None admin] RBAC: Authorizing `identity:get_group(group_id=de0564dfe0964348b848a07fd4a1bbdf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:54.048264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a424-9559-4c3b-ab72-94172ceacc45 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:54.049916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 228/454] 10.222.0.61 () {56 vars in 1180 bytes} [Fri May 27 03:09:53 2022] GET /identity/v3/groups/de0564dfe0964348b848a07fd4a1bbdf => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:54.056582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:54.160656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd710-112d-4fa1-9cd2-77e9651f5b67 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:54.195583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:54.196247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:54.196528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:54.196801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:54.197629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] RBAC: Adding query filter params (group.id=de0564dfe0964348b848a07fd4a1bbdf, role.id=d0122fde930842079d42ce76139767e2, scope.project.id=3b90443493d84a01a8c521f600d4b6fc) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:54.197939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:54.199427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e00446-072e-4413-988a-33137dab7b80 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:54.205879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 227/455] 10.222.0.61 () {56 vars in 1376 bytes} [Fri May 27 03:09:54 2022] GET /identity/v3/role_assignments?group.id=de0564dfe0964348b848a07fd4a1bbdf&scope.project.id=3b90443493d84a01a8c521f600d4b6fc&role.id=d0122fde930842079d42ce76139767e2 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:56.996456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534d00-ec2f-43d3-b458-c79aa862e5c1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:56.997330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534d00-ec2f-43d3-b458-c79aa862e5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:56.997782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534d00-ec2f-43d3-b458-c79aa862e5c1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:56.999652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 229/456] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:57.004696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.005439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.005862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.031678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:57.033678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:57.117743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cd196-8690-4255-b2c7-48c88c77e09b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.118410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cd196-8690-4255-b2c7-48c88c77e09b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.118883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cd196-8690-4255-b2c7-48c88c77e09b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.120877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 230/457] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:09:57.126792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee69a1-8c9c-4394-8d37-7f2be8aa4422 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.127362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee69a1-8c9c-4394-8d37-7f2be8aa4422 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.127843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee69a1-8c9c-4394-8d37-7f2be8aa4422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.128673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:57.139789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 228/458] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:57.159291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7cee69a1-8c9c-4394-8d37-7f2be8aa4422 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:57.160547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7cee69a1-8c9c-4394-8d37-7f2be8aa4422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:57.167483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.259576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 231/459] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:09:57.261068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1df4-6077-4f20-9302-91b87b96b666 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.261549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1df4-6077-4f20-9302-91b87b96b666 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.262006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1df4-6077-4f20-9302-91b87b96b666 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.267985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 232/460] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:57.270469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.270757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.271033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.308179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:57.309807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:57.326930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6dc7c-b3e6-4d7a-b151-8631304bb0c5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.365014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.365807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.366809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.367225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.378852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.380524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.390061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 233/461] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:57.391004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:09:57.402961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:57.404143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:57.405215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:09:57.405215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:09:57.405215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:57.405215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:57.407096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 229/462] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:57.411194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:57.413658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.479393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:57.535020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901880f7-68e1-4aa7-a93f-d64b968b8037 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.562277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ee4ee-6cc6-40e7-a3fb-a5d75d0ba911 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.574144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.575432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.575889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.576368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.590473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.592314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.601386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.602402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.602860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.603334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.604339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:57.604829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.606432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:09:57.614769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:57.615687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:57.617444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:09:57.617444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:09:57.617444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:57.617444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:57.621732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 234/463] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:57.622730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.625996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 230/464] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:57.627173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.696401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:57.742598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783badb-0057-4e45-b98e-bf0dc9ce3ce3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.743284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87355d8e-0595-489a-8163-27a69e36a5e9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.751113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:57.781117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.781636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.782465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.782749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.783006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.783107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.783732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.784222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.785306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:57.785885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.787535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.793654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.795604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.801120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 231/465] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:57.802154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:09:57.822165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:57.823299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:57.824228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:09:57.824228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:09:57.824228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:57.824228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:57.824228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 235/466] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:57.824228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:57.925145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce084f7-ce96-48d0-9010-2c84a8597a2e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.933145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50162c5-f52e-4600-ad8a-e6597c1de1ec None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:57.945622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:57.966977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.967655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.967937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.968212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.968949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.970666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.972562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0f726-3dc5-42a4-bb4f-ad85dc1ca385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:57.973283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f726-3dc5-42a4-bb4f-ad85dc1ca385 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:57.973577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f726-3dc5-42a4-bb4f-ad85dc1ca385 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:57.973817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f726-3dc5-42a4-bb4f-ad85dc1ca385 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:57.974622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0f726-3dc5-42a4-bb4f-ad85dc1ca385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:57.976702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0f726-3dc5-42a4-bb4f-ad85dc1ca385 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:57.996491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 232/467] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:57 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:57.997531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:58.008560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 236/468] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:57 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:58.012195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee108d-cfec-42b8-b16c-8b0fd8785b77 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.013167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee108d-cfec-42b8-b16c-8b0fd8785b77 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.014052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee108d-cfec-42b8-b16c-8b0fd8785b77 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.017355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 237/469] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:58.024626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.025261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.025722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.048146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:58.049757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:58.066426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:58.144321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 238/470] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:58.202000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:58.229995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e6ef9-fced-48d6-928d-4370ac33c1b8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:58.293412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:58.293786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.294111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.294391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.295179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:58.295434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:58.296843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:58.317461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 233/471] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:58.318926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:58.341571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:58.350240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36605e-363c-46a3-8838-1094a7e583ec None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:58.394360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:58.395177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.395456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.395728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.406747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:58.408536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ca0510f2-19c8-44c9-ac5f-87f1c7e99013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:09:58.428067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:58.429644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:58.430550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:09:58.430550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:09:58.430550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:09:58.430550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:58.430762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:58.432547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 239/472] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:58.433978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab53b7-97c9-42be-9f8d-55d3a9565160 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.434396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab53b7-97c9-42be-9f8d-55d3a9565160 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.435085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab53b7-97c9-42be-9f8d-55d3a9565160 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.436651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 240/473] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:09:58.441196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab53b7-97c9-42be-9f8d-55d3a9565160 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:58.457733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d0cd2-f1b8-4d3d-9ed7-494d997de473 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:58.500122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78eba9-d3e2-4d18-8772-c39dc93c7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:58.501104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78eba9-d3e2-4d18-8772-c39dc93c7d0b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.501599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78eba9-d3e2-4d18-8772-c39dc93c7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.502105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78eba9-d3e2-4d18-8772-c39dc93c7d0b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.503010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78eba9-d3e2-4d18-8772-c39dc93c7d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:58.504682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78eba9-d3e2-4d18-8772-c39dc93c7d0b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:58.537695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 234/474] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:58 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:09:58.537695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.537695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.537695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.571748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:09:58.572897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:09:58.613908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab53b7-97c9-42be-9f8d-55d3a9565160 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:58.677226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:58.677904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.678210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.678486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.679253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:58.679565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:58.680993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:58.708664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 241/475] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:09:58.716114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:58.735361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 235/476] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:09:58.739437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:58.783184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:58.839241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ddd4-8b8f-4f3e-aca0-09946fbc8dd2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:58.860682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:58.877214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:58.878083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.878450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.878826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.879662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:58.881222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:58.899962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06588b-fd71-4fca-96e4-f7a64eb36618 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:58.908494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 242/477] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:09:58 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:09:58.948703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:58.949394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:58.949676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:58.949950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:58.950772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:58.952204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:58.960935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 03:09:58.960935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 03:09:58.960935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [parameters: {'id': '4150e339da374be0a429ac6d970d63e3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 03:09:58.960935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 27 03:09:58.982762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return ref.to_dict() May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:09:58.983742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 03:09:58.984683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 03:09:58.985651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:09:58.986604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:09:58.987508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'id': '4150e339da374be0a429ac6d970d63e3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:58.988492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 03:09:58.989309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:09:58.992144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 236/478] 10.222.0.61 () {60 vars in 1131 bytes} [Fri May 27 03:09:58 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 03:09:58.993604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:59.104031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:59.150312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf0ea-596e-4c9d-91aa-feb9ffbf99bc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:59.186016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214e36-638b-4132-815c-9520ffad2b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:59.186849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214e36-638b-4132-815c-9520ffad2b50 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:59.187132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214e36-638b-4132-815c-9520ffad2b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:59.187410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214e36-638b-4132-815c-9520ffad2b50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:59.199512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79214e36-638b-4132-815c-9520ffad2b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-79214e36-638b-4132-815c-9520ffad2b50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:09:59.207798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:09:59.208722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:09:59.209605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:09:59.211367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 243/479] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:09:59.219050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:09:59.329060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4350e-d7c1-4465-96aa-4e6f8be7413e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:09:59.360198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:09:59.366731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:09:59.367670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:09:59.368110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:09:59.368733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:09:59.369628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:09:59.370111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:09:59.371782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d9e3-64ff-4c30-9cf5-9e40c216fedb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:09:59.382791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 237/480] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:09:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:00.669412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61525-80ed-4165-a570-4582a71936e3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:00.669955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61525-80ed-4165-a570-4582a71936e3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:00.669955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61525-80ed-4165-a570-4582a71936e3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:00.671681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 244/481] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:00.677358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:00.677784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:00.678029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:00.696094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:00.697473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:00.790219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 238/482] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:10:00.818715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71e2b-9f2b-442f-a684-a41ab3521dae None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:00.820085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71e2b-9f2b-442f-a684-a41ab3521dae None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:00.820834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71e2b-9f2b-442f-a684-a41ab3521dae None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:00.823787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 245/483] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:00.828531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:00.829655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:00.830157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:00.830612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:00.867457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:00.868662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:00.947058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e53c2e-a269-4bfc-9679-5590bb6a01e4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:00.976863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:00.994364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:00.995316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:00.995737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:00.996100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.012424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:01.023441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:01.025595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:01.026683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:01.027312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 246/484] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:01.027392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 239/485] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:01.031950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.061338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.160392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:01.208358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dbeba-688f-482c-8626-4b613bf7b4ce None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:01.247091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:01.247510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.247848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.248121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.258475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9655-f526-4ea2-9133-7a8a860fb7a6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:01.259683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:01.267701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:01.270067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:01.272167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:01.274796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 240/486] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:01.279834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.324335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:01.382687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:01.383234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063f44e-38de-43e4-bb2e-264cf2c165cd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:01.383442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.383651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.383933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.384693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:01.385062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:01.386512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:01.408470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 247/487] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:01.414330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.418783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:01.419465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.419751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.420020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.420827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:01.421185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:01.422636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:01.437046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 241/488] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:01.438626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.609396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d8cd-76f1-4633-8b9b-26456e9a3c58 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:01.630360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:01.648670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12b8ad-1fb9-44f7-8325-5ed72f222d69 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:01.650331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:01.651166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.651440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.651713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.670411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:01.672225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:01.673481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3be2b948-ae5a-4278-ad8d-08d918a315a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:01.694122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:01.695385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:01.696248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:01.696248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:01.696248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:01.696248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:01.696483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:01.696483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.696483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.696483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.699378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 242/489] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:01.701195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62288e-84ca-4ffb-a875-fa1f2d2cccbc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.701693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62288e-84ca-4ffb-a875-fa1f2d2cccbc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.702230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62288e-84ca-4ffb-a875-fa1f2d2cccbc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.708329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 243/490] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:01.709251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:01.710466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62288e-84ca-4ffb-a875-fa1f2d2cccbc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.711512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b3a7a766-f9ba-4cb8-8429-267dd5aa8500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:01.735485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:01.736435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:01.737285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:01.737285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:01.737285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:01.737285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:01.737285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 248/491] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:01.739097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.739389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.739667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.760988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:01.762140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:01.839436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62288e-84ca-4ffb-a875-fa1f2d2cccbc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:01.851421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 249/492] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:01.859181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.881185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:01.882376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:01.882658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:01.882931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:01.883802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:01.884115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:01.885834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:01.901451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 244/493] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:01.902413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:01.928110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:01.989169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:01.994536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72e9d8-419e-4eb3-b424-2ae897517c74 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.034058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.034744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.035013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.035291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.036011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:02.036320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.037720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.039706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40353d0c-d96c-401a-9e69-295cb16227fa None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.053951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 250/494] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:02.054976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.077102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2a556-71fd-4a68-abf9-fe7546d8eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.077898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a556-71fd-4a68-abf9-fe7546d8eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.078204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a556-71fd-4a68-abf9-fe7546d8eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.078475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a556-71fd-4a68-abf9-fe7546d8eeb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.092468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a556-71fd-4a68-abf9-fe7546d8eeb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3fd2a556-71fd-4a68-abf9-fe7546d8eeb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:02.104660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:02.105653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:02.106863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 245/495] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:02.107572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45e9a-81a3-4af1-ac35-4f2c18c94f8b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.108234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45e9a-81a3-4af1-ac35-4f2c18c94f8b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.108655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45e9a-81a3-4af1-ac35-4f2c18c94f8b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.114094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 246/496] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:02.114094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45e9a-81a3-4af1-ac35-4f2c18c94f8b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.175611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad6209-cf50-45a6-9de2-d7844c73fd2b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.198476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.215195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.216108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.216397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.216680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.224931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45e9a-81a3-4af1-ac35-4f2c18c94f8b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.225110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.226669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:02.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:02.248380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:02.249317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:02.250757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 251/497] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:02.251782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.268803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.269902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.270344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.270763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.273915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.280335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.281818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b0f41222-e838-432f-83f4-8e87429f5625 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:02.298246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:02.299222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:02.300135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 247/498] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:02.301590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.301590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.301590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.319604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:02.320821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:02.365356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bee5a-6007-40b8-8881-0cd2b7b01198 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.398023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 248/499] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:02.398023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.407232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.408147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.408627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.409044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.409991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:02.410444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.411998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.421997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 252/500] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:02.422977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.476140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.509610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.510498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101451f-34c0-43d3-b1ee-a9da18162e17 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.529778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4e87-30c0-41e9-a499-a7873e3957aa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.546438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.547114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.547392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.547669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.548493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:02.548800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.550261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.564022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.564712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.564997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.565274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.566176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:02.566491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.567987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.589207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 249/501] 10.222.0.61 () {56 vars in 1137 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:02.590106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.608454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 253/502] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:02.609327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.693546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebcc85-11d0-4013-8d28-9757c4b685eb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.708979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3389c2-5b66-4b75-bb2d-86df115ab97c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.721860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.731242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7779af-37c5-47f8-a078-5cad4c787caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.731977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7779af-37c5-47f8-a078-5cad4c787caa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.732263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7779af-37c5-47f8-a078-5cad4c787caa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.732539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7779af-37c5-47f8-a078-5cad4c787caa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.742784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7779af-37c5-47f8-a078-5cad4c787caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:02.743682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.744474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.744756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.745026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cb7779af-37c5-47f8-a078-5cad4c787caa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:02.750581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:02.751486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:02.752304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 250/503] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:02.752979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.753049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38102133-5178-4726-99bb-4e86dcffde34 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.753258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38102133-5178-4726-99bb-4e86dcffde34 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.753532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38102133-5178-4726-99bb-4e86dcffde34 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.754842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 251/504] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:02.755533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38102133-5178-4726-99bb-4e86dcffde34 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.761236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.763210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:02.783063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:02.784035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:02.784898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:02.784898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:02.784898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:02.784898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:02.784898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 254/505] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:02.785185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:02.860784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38102133-5178-4726-99bb-4e86dcffde34 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.884641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d60c9b-dd92-46a0-a24b-4ec9ae217629 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:02.894769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.895420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.895704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.895974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.918419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8db7d-deff-4fa6-934c-0cc6b86c003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:02.919068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8db7d-deff-4fa6-934c-0cc6b86c003c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:02.919352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8db7d-deff-4fa6-934c-0cc6b86c003c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:02.919629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8db7d-deff-4fa6-934c-0cc6b86c003c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:02.950888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.965247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:02.966753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:02.979885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:02.998410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8db7d-deff-4fa6-934c-0cc6b86c003c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.000127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8db7d-deff-4fa6-934c-0cc6b86c003c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.080233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 252/506] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:03.081082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.117037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 255/507] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:03.118380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.118672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.118949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.135399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:03.136720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:03.166459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.182115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192436-f915-4e83-b7be-e9104977170a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.203268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 256/508] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:03.204124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.225895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.226682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.227026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.227366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.228054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.228166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:03.228560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.230087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.238815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 253/509] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:03.239613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.314106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553546ec-70d6-414e-90f5-6dd4176f3527 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.340341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2f44-4801-436e-a4cb-649379add6e4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.348455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.349127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.349407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.349692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.351015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:03.351323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.352714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.364020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 257/510] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:03.364841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.379825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.380617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.380891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.381207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.392437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.393912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.403630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:03.416302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:03.417362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:03.418323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:03.418323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:03.418323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.418323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:03.422033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 254/511] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:03.423246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.449688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.471631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbb2eb-5d41-4e8b-a374-b5acba590582 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.517530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.518441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.518642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.518913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.534418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.535848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29126-b15f-45e0-aa86-378a12b53e69 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.536649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:03.556040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:03.557056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:03.557930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:03.557930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:03.557930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.557930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:03.557930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 258/512] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:03.558307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.577646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027614e-4663-483a-add5-20f41be45980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.578398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027614e-4663-483a-add5-20f41be45980 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.578679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027614e-4663-483a-add5-20f41be45980 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.578952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027614e-4663-483a-add5-20f41be45980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.589883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027614e-4663-483a-add5-20f41be45980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.591536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027614e-4663-483a-add5-20f41be45980 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2027614e-4663-483a-add5-20f41be45980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:03.611160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:03.612963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:03.613818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:03.613818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:03.613818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.613818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:03.613818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 255/513] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:03.613818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027614e-4663-483a-add5-20f41be45980 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.669519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.670609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21dc2-8a36-40b7-9ca1-d0b5e2497147 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.701276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.707082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.707879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.708158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.708425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.717127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027614e-4663-483a-add5-20f41be45980 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.719939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.721403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:03.738732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:03.739797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:03.740828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:03.740828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:03.740828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:03.740828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:03.740828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 259/514] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:03.741185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.756193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.757534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.757812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.758112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.767024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.768486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:03.784174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:03.785179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:03.786134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 256/515] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:03.786712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.849738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce81ac-cac5-4ee7-b95d-211327c5a7f9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.883525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.884186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.884467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.884739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.885447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:03.885749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.887183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.890507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a81417-c60f-45af-b1c1-2827e682cd8f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:03.898656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 260/516] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:03.899465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:03.907398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.929160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:03.929821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:03.930144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:03.930423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:03.931134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:03.931442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:03.932828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:03.943858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:03.945428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 257/517] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:03.946560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.012296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718860e-8d7d-4fe9-a457-32d54d1f1e56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.054937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e013eb-6628-4572-80ab-f34c37726960 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.057738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.058919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.059430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.059930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.061300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:04.061856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.064525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.078289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 261/518] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:04.079110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.093035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.093696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.094003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.094276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.095243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:04.095542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.096930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.108841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 258/519] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:04.109586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.142048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.193440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d911ea-9001-4548-9c2b-2f296b30c17c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.196293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.216342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b9ab3-3a22-46ef-9fc1-d5bc6f8b79b8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.228383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.229070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.229351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.229627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.230497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:04.230806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.232270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.248671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.249276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 262/520] 10.222.0.61 () {56 vars in 1137 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:04.249455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.249734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.250021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.250113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.257984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.259429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:04.275514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:04.276555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 259/521] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:04.277446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.353727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da380e4-13a1-43c0-9dd8-750107261cfd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.371336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.380029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc321d-dad7-4242-b2f1-5169e84cd183 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.388009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.388808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.389090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.389364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.396373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.398432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:04.413284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:04.414386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 263/522] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:04.419954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.420584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.420584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.420584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.420584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.420877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.420877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.440016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 260/523] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:10:04 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:04.440788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.443023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.545001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb473d-f4b4-455b-8ffc-ab8a85ab894f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.564215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d62a3-9033-4fa4-9e82-8c9662dda083 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.583557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.584300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.585121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.585394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.595027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.596517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.603124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.603796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.604188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.604357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:04.612847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:04.613856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 264/524] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:04.615201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.630059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.691653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.693122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.715176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.739661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e78b6-bfe6-4fa1-b0af-957aba9792fb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.781667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.782723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.783289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.783666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.784461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:04.784776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.786239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.804375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 261/525] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:04.804375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.819937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 265/526] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:04.819937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.852594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.913093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedb9d-e9ce-4135-9d71-57d59dc76b52 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.927499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6b43-a77a-43b0-920d-d15a727cd3ff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:04.948555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.949219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.949498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.949767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.950588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:04.950894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.952323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.964482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:04.965185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:04.965467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:04.965742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:04.966721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:04.967043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:04.968499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:04.970800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 262/527] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:04.971809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:04.990232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:04.998113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 266/528] 10.222.0.61 () {56 vars in 1139 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:04.998972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.092579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253059-f1f3-4c79-83c1-6567ef636bff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.104028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:05.111774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11333c3d-2287-46b2-bcf3-b3ea748da3df None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.133755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.134536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.134816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.135415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.146068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.148118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.150339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.151004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.151284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.151557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.152379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=b8bc75da330c48aab2b15609eb495cc0) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:05.152686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.154148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.169388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 267/529] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/role_assignments?user.id=b8bc75da330c48aab2b15609eb495cc0&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:05.169388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:05.169666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:05.171210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:05.172296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:05.172296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:05.172296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:05.172296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:05.172296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 263/530] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:05.172296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.261276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:05.314493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44728e-4dcf-4e7e-a794-8fb749212780 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.323505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d924ba-fdf2-4b08-bd3f-9f3484600eaa None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.363728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.364646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.364772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.364952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.365182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.365344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.365588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.366426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.367264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=9799f9d11546403e8b46ad386be470d8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:05.367574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.369039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.376286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 268/531] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/role_assignments?user.id=9799f9d11546403e8b46ad386be470d8&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:05.383541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.402408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:05.520016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f86fb-0d2e-43c8-85ea-e916f0ed0f5f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.553483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:05.561328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.563733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.564632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.565321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.565603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.566246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.566999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:05.567308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.568716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.591673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 269/532] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:05.591673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.718870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74fe88-7f7d-4c6b-825c-e06f98f005e9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.756942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.757694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.757935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.758236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.765999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.766955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 264/533] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:05.773985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.774689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:05.790309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:05.791250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:05.792098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:05.796323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 270/534] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:05.797595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:05.851940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:05.908806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20a299-4dc4-4179-ae3b-c03e9bba4c15 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:05.915061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:05.947709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:05.948458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:05.948746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:05.949023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:05.949816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:05.950156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:05.951622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:05.970259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 271/535] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:05.972814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:06.011327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd7dd3-de5e-44ed-83d9-978ea76d84e6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:06.072208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:06.073431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:06.073913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:06.074411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:06.091052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992614-b265-4510-ba21-e021cc96ff53 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:06.097984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:06.099797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:06.102918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:06.127534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:06.128524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:06.129372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:06.129372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:06.129372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:06.129372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:06.129582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:06.138468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:06.138468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:06.138468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:06.138468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=2f646e6869e44b20adf102b964394512) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:06.138468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:06.138468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:06.140802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 265/537] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:06.144898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 272/537] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:05 2022] GET /identity/v3/role_assignments?user.id=2f646e6869e44b20adf102b964394512&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:06.146255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:06.265275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f7f08-9bd1-449d-aee2-9b9cbb065a17 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:06.282329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:06.308821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:06.309501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:06.309780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:06.310084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:06.310814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:06.311114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:06.312533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:06.325900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 266/538] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:06.331520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:06.502411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d78b-75fb-4361-bc8d-5a60bdb52cff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:06.562954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:06.563709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:06.563989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:06.564259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:06.575252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:06.576751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:06.595204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:06.596105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:06.597433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 273/539] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:06.604312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:06.771710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435030b-3f61-4157-977c-d0be6735a2ba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:06.825818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:06.826537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:06.826870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:06.827143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:06.827995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:06.828306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:06.829785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247447-37db-4986-88f6-74d05c5d3fa4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:06.850602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 267/540] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:06.856562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:06.911427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:07.029637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bd86-0a9d-41cc-b230-b3384ebfdb11 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:07.095842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:07.096493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:07.096781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:07.097042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:07.098032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=aa9aadf0069b45758a89cfb6a737082d) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:07.098336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:07.099792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b5fbf-d6c0-4145-8715-03876de93bcd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:07.107687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 274/541] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:06 2022] GET /identity/v3/role_assignments?user.id=aa9aadf0069b45758a89cfb6a737082d&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:07.139283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce23f4-f66c-49ca-8e2d-21c9cbe0f7cd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:07.139878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce23f4-f66c-49ca-8e2d-21c9cbe0f7cd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:07.140068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce23f4-f66c-49ca-8e2d-21c9cbe0f7cd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:07.142658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 268/542] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:07.150876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:07.151142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:07.151504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:07.173394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:07.175075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:07.283857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 275/543] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:07.319800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce23f4-f66c-49ca-8e2d-21c9cbe0f7cd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:07.368759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:07.447297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce23f4-f66c-49ca-8e2d-21c9cbe0f7cd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:07.484540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:07.485344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:07.485624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:07.485893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:07.497938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:07.508462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:07.509639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:07.510582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 269/544] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:07.517528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:07.561984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:07.659412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e4e6d-1215-4789-adff-25125289e2bc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:07.715420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:07.716118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:07.716396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:07.716670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:07.717425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:07.717728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:07.719138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:07.732593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 276/545] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:07.738055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:07.845459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e38c3-b693-4cb8-bb16-99147d92257a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:07.847114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:07.882070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:07.882870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:07.883149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:07.883418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:07.895193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:07.896673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d383892a-1afc-4d69-a5cb-8be28201d451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:07.916093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:07.917032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:07.918378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:07.918378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:07.918378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:07.918378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:07.918378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 270/546] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:07.923118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.038413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:08.048184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dff323-122f-4fde-8bd5-6c5062754f36 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.048504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dff323-122f-4fde-8bd5-6c5062754f36 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.048750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dff323-122f-4fde-8bd5-6c5062754f36 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.050328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 271/547] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:08.056242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.056530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.056731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3025c6d-57ff-4eeb-abcd-4b97399994bf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.056854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.075262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:08.076528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:08.130768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.132028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.132306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.132576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.133303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:08.133611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:08.135073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:08.169507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 277/548] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:08.182615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.218637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 272/549] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:10:08.242950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.354922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd29d91-b56c-4f96-9d5e-49edb1d12733 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.358433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:08.388042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d50c30-30e6-4a60-9715-a985ced36e52 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.399973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.400842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.401227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.401785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.415575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:08.424171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:08.425492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:08.426723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:08.427378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 273/550] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:08.434278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.440024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.441082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.441452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.444861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.472611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:08.478995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:08.516649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:08.518984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:08.521567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:08.528972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 278/551] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:08.535194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.560601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:08.663844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087d837-853e-4a3e-99f2-b7faec07982d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.673651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4abdf-520c-44a7-a07e-0eb7d0ab4814 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.703949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.705102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.705593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.706127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.707454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:08.708139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:08.711019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ae023-bd4f-432a-9e28-664a3fba7db7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:08.711153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.711733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.712011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.712286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.713122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:08.713428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:08.714279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:08.715094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:08.729361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 274/552] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:08.731300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095ddc-539e-4bb7-8492-c00a162f10bc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.731849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095ddc-539e-4bb7-8492-c00a162f10bc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.732351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa095ddc-539e-4bb7-8492-c00a162f10bc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.734232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 279/554] 10.222.0.61 () {56 vars in 1135 bytes} [Fri May 27 03:10:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:08.734486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 275/554] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:08.738150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.739968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa095ddc-539e-4bb7-8492-c00a162f10bc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:08.848344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:08.878893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa095ddc-539e-4bb7-8492-c00a162f10bc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.902493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf915c-355f-4326-b133-a50415b4ae87 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:08.921599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae59bb-8f1e-48f4-b1d8-72f6e7254ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.922538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae59bb-8f1e-48f4-b1d8-72f6e7254ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.922981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae59bb-8f1e-48f4-b1d8-72f6e7254ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.923404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae59bb-8f1e-48f4-b1d8-72f6e7254ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.951506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:08.952500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:08.952930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:08.953304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:08.968513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:08.970634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-23fef12b-46fc-4001-bcfd-8ae41ac8f3af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:08.996650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:08.997656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:08.998569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:08.998569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:08.998569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:08.998569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:09.000819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 280/555] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:09.002399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.002869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.003301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.014771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.023404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:09.024549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae59bb-8f1e-48f4-b1d8-72f6e7254ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:09.024703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:09.026057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae59bb-8f1e-48f4-b1d8-72f6e7254ba6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:09.113989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 281/556] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:09.113989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.166431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.186115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 276/557] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:09.187882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6953f6-524b-4d60-883d-15cba32ba291 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.188266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6953f6-524b-4d60-883d-15cba32ba291 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.188717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6953f6-524b-4d60-883d-15cba32ba291 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.194869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 277/558] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:09.194869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6953f6-524b-4d60-883d-15cba32ba291 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.230807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aa18a-96ba-4b9d-987d-5419dc0df296 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.274254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.275173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.275625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.276046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.277066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:09.277374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:09.278788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:09.295743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 282/559] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:09.295743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.333534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.342089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6953f6-524b-4d60-883d-15cba32ba291 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.382067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb18007-5bca-489c-8581-3404bb7662ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.382847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb18007-5bca-489c-8581-3404bb7662ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.383240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb18007-5bca-489c-8581-3404bb7662ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.383984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb18007-5bca-489c-8581-3404bb7662ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.397109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb18007-5bca-489c-8581-3404bb7662ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6fb18007-5bca-489c-8581-3404bb7662ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:09.405360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:09.406649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:09.407503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 278/560] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:09.408663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34848-027a-47d2-add7-989f340961ee None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.408663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34848-027a-47d2-add7-989f340961ee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.408897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34848-027a-47d2-add7-989f340961ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.426472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69a34848-027a-47d2-add7-989f340961ee None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:09.427670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69a34848-027a-47d2-add7-989f340961ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:09.428971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943f970-730a-49ad-8838-4dd311c13ade None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.442494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.473650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.475629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.475629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.475969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.490555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:09.494535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:09.518866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 279/561] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:09.519725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34848-027a-47d2-add7-989f340961ee None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:09.522522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:09.523429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:09.524361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:09.524361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:09.524361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:09.524361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:09.527474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 283/562] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:09.528544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.629291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.653123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34848-027a-47d2-add7-989f340961ee None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.667267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4d25-ae2a-4896-aadf-6228f44d2e1a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.696418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.697578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.697927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.698280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.706732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:09.708182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:09.712783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.713868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.714271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.714552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.715303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:09.715610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:09.716985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:09.723493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:09.724534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 280/563] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:09.726536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.733351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 284/564] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:09.734940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.766553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.851467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21862-829a-4a35-8d02-25a6b5135a6b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.859453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfec66-5fb7-47b9-b7dc-b7ea92c551e0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:09.894555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.895728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.896164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.896622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.897542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:09.898031 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:09.899596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:09.901356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:09.902688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:09.903014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:09.903299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:09.913298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 281/565] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:09.914491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:09.918798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:09.924622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:09.927370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:09.928895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:09.929762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 285/566] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:09.930513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.031749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.033673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56b560-aa94-4d1c-ab0d-a61697266d1d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.061039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910017cd-8e08-4b51-96f7-835c21c2448c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.074215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.074978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.075267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.075539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.076462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:10.076772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.078253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.096421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 282/567] 10.222.0.61 () {56 vars in 1137 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:10.097919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.098744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.098933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.099034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.099281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.110446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.111929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:10.129394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:10.130450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:10.131919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:10.131919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:10.131919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:10.131919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:10.131919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 286/568] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:10.132207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.172248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.217327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba66e23-ec7f-4c4a-bd85-60d64aae2680 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.243329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76460e57-bf62-4d22-9052-f42c71810b3a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.253940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.254768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.255050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.255318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.262511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.263958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e80d227c-bb83-4f81-b844-2d78cb380938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:10.278584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:10.279569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:10.280506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:10.280951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.280951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.281113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 283/569] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:10.281183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.281183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.281321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e3e2-3eee-4de7-8969-3899d1580311 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.282005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:10.282106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e3e2-3eee-4de7-8969-3899d1580311 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.282179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.282263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e3e2-3eee-4de7-8969-3899d1580311 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.288005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 284/570] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:10.288173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.288278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e3e2-3eee-4de7-8969-3899d1580311 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.290392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.295308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 287/571] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:10.296410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.404326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8464c-4ad0-4ecd-a5b6-a2296a246328 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.405778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e3e2-3eee-4de7-8969-3899d1580311 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.432234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.442588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.443153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.443276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.443574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.443850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.444017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.444300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.444574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.444672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:10.444919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.446387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.456587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.458130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.460168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 288/572] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:10.461124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b3042593-66bd-4f98-b9cb-2db3b4b0b8fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:10.479600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:10.480764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:10.481675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:10.481675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:10.481675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:10.481675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:10.481675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 285/573] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:10.482246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.482505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.482781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.501607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:10.502857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:10.528404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.575695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 286/574] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:10.576495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.576934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a9454-75f2-424c-894a-9f99e290496b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.615115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.616310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.616593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.616871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.617674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:10.618014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.619494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.632550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 289/575] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:10.633428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.685574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8551452-1e6f-4b78-9d03-cfcfc9b7e6ee None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.693440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.721850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.722743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.723027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.723295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.733537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.735026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.738714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262d69-aa47-47ac-9e23-86037e2c3ef5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:10.753121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:10.755032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:10.756046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:10.756046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:10.756046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:10.756046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:10.756046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 287/576] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:10.756046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.761302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.781265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.782112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.782402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.782677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.791074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.793266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:10.811441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:10.812481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:10.813459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 290/577] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:10.814472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.860875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0a23b-9f11-4d87-b7be-66e8d60a27f7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.895572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.896231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.896512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.896787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.897491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:10.897798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:10.899196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:10.910230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 288/578] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:10.910986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:10.922167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be472e3f-fa27-4b75-8dcd-0869931ae576 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:10.936100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:10.957181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:10.957989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:10.958279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:10.958548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:10.969157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:10.977410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:10.978634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:10.979587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 291/579] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:10.980517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.019116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.026902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9b403-f44c-422e-90e0-c0fa960bbc06 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.068140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.069352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.069629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.069901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.070749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=effdc345daee49d8ad4a09f2dd6fd40e) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:11.071059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.072493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.077813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 289/580] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/role_assignments?user.id=effdc345daee49d8ad4a09f2dd6fd40e&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:11.078607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.090060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120a70-ee85-4bdf-b956-9889f65ed7a6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.139847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.140903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.141089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.141344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.142126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:11.142440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.143917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.158143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 292/581] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:11.159171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.189492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.214529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e006f-a50b-453c-a151-89853a53fbac None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.252118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.252809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.253092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.253366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.254233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:11.254542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.256563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.267678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.277956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f51f5-61e9-43da-9f5b-35911300a61f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.286068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 290/582] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:11.286920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.320138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.321114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.321406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.322034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.329730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.331230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:11.349658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:11.350864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:11.352350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:11.353719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 293/583] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:11.355177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.416464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397532-7536-4c36-b3fd-5e415cb9d140 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.460266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.461226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.461504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.462241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.462995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:11.463309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.464710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.471156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28390a-0dfa-4203-8638-95d264d9d6cb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.474145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 291/584] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:11.474717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.477410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.519155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.519970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.520254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.520532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.528515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.530023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:11.546595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:11.547619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 294/585] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:11.548691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.574024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.598041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2058336-8c87-4d9c-957c-a37fa947ed76 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.640615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.641413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.641696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.641990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.652661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.654156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.670552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82265870-de77-4ca0-a0df-f41ee83da1ed None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:11.671767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:11.672640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:11.673551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:11.673551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:11.673551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:11.673551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:11.673551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 292/586] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:11.673828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.713950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.715001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.715464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.715919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.716895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:11.717400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.719918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.734971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 295/587] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:11.735697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.737774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.791928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744eb5-42d0-4815-ba23-66af65a8a0a8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.828268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.829071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.829352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.829622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.832423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:11.841352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.843066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.859737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3224c-1855-41a8-a713-16bec69a92df None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:11.861626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:11.862575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:11.863620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:11.863620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:11.863620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:11.863620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:11.863620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 293/588] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:11.868547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.900194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:11.900869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:11.901149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:11.901421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:11.902294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:11.902604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:11.904033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:11.922409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 296/589] 10.222.0.61 () {56 vars in 1137 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:11.923121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:11.987177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23872ec-3fe5-48b5-8332-0813005fb7d5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:11.995741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.028057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.028732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.029015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.029289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.030029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:12.030360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.031722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.037990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034e86-b169-4462-bc0d-c1afe90efeef None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.044656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 294/590] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:12.045476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.085123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.086329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.086616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.087579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/b8bc75da330c48aab2b15609eb495cc0/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.089627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.104853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=b8bc75da330c48aab2b15609eb495cc0, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.106426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.120680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 297/591] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:11 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/b8bc75da330c48aab2b15609eb495cc0/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:12.132983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.173212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f3003-87cb-4218-9e88-9120f2fd49f6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.222547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.223580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.223915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.224197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.225569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:12.226369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.228290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.247878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 295/592] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:12.248873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.283286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.305046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce516a6-da71-4c0d-bd33-43d4e0e45cb1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.352237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.354343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.354835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.355175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.367787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.369546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.377131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a8242-83ca-4cfc-bfc6-7c82c15f4d83 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:12.402276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:12.403240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:12.404151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:12.404151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:12.404151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:12.404151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:12.407280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 298/593] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:12.408144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.423375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.424082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.424360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.424647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.434438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.436604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:12.455349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:12.456332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 296/594] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:12.457686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.463735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.569988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.573080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ed6f9-f29e-489a-ad2a-d19321b67c9e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.588285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bcd34-7578-46d2-9185-14331c6cc121 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.620656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.621934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.622526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.622954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.624219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.624983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.625361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.625838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.626599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:12.627459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.628467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.633850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.635595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.644720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 297/595] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:12.645769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:12.657494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:12.658751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:10:12.659935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:12.662372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 299/596] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:12.663405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.760074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6e1c-bc4c-4f3c-aa43-0d27916b7813 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.767266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.775035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c33781-655c-42a4-84ff-8e0d673f7176 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.797949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.798857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.799241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.799612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.800550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:12.800894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.802641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.814708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.815758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.816194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.816622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.821722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 298/597] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:12.822783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.825286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.828016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.831886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:12.846050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:12.847195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:12.848410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:12.851320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 300/598] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:12.852513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:12.934063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9fe5-aef2-4004-a265-4718c53c0a5c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:12.979674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:12.981734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:12.982733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:12.983408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:12.985437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:12.986096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:12.987889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:12.988907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500deeb9-067e-41ba-a72f-f76acf280980 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.014625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 299/599] 10.222.0.61 () {56 vars in 1139 bytes} [Fri May 27 03:10:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:13.015778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.039025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.040112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.040534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.040911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/9799f9d11546403e8b46ad386be470d8/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.059211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=9799f9d11546403e8b46ad386be470d8, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:13.061075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:13.082381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 301/600] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:12 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/9799f9d11546403e8b46ad386be470d8/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:13.083445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.099147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:13.105220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:13.162607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d442f-da76-4749-a91a-a91d2237520b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.213912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.215157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.215628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.216093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.217169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:13.217781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:13.219522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:13.246500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 300/601] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:13.252576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.271669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671e780-8627-4f3e-b03c-0281fafe2dcc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.328356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.329168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.329449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.329720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.341571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:13.343195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1db8329d-fa28-4e69-a17d-5ea6ae8abd52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:13.368292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:13.369433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:13.370561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:13.370561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:13.370561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:13.370561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:13.370796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 302/602] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:13.372107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e5877-399c-457f-9cda-9d95b255dc82 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.372374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e5877-399c-457f-9cda-9d95b255dc82 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.372652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e5877-399c-457f-9cda-9d95b255dc82 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.373955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 303/603] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:13.375825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e5877-399c-457f-9cda-9d95b255dc82 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.390354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d47077-d372-4325-83a8-607c71ceeaf9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.419366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:13.432173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808882e4-6f53-4cae-b133-7bd53fd143bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.433076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808882e4-6f53-4cae-b133-7bd53fd143bf None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.433353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808882e4-6f53-4cae-b133-7bd53fd143bf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.433623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808882e4-6f53-4cae-b133-7bd53fd143bf None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/2f646e6869e44b20adf102b964394512/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.449346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808882e4-6f53-4cae-b133-7bd53fd143bf None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=2f646e6869e44b20adf102b964394512, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:13.450841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808882e4-6f53-4cae-b133-7bd53fd143bf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:13.460787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:13.476963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 301/604] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:13 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/2f646e6869e44b20adf102b964394512/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:10:13.478472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.478832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.479179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.503239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:13.504761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:13.517447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e5877-399c-457f-9cda-9d95b255dc82 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.560255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.561260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.561778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.562351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.563320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:13.563829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:13.565519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:13.578703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 304/605] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:13.584670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.606064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 302/606] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:13.627896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.760887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105a9aa-7ce4-439f-8b4e-a550c6c6df54 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.779415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dae7a-a7de-431c-9291-febc243b1b78 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:13.780355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:13.791566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:13.806652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.807463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.807750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.808026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.816193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:13.817712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:13.826685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:13.827495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:13.827769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:13.828036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:13.833186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:13.834680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:13.835584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 305/607] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:13.839877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:13.840728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:13.850843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:13.852735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:13.854344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 303/608] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:13.859120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:13.952786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035f0f4-3338-4197-ad13-fd771ca12aa9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:14.006164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:14.008385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.008673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.008943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.009732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:14.010057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:14.011515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:14.036563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 306/609] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:14.042278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67d384-fc67-4b40-9df9-decb464564ea None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:14.044589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:14.124203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:14.124807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.125085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.125356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.126144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:14.126451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:14.127824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:14.129662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:14.154207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 304/610] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:14.164486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:14.225751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:14.267564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1e18-36dd-45b4-846d-9e877143b4b3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:14.342712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:14.343617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.343892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.344162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/aa9aadf0069b45758a89cfb6a737082d/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.353401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4dc22-c4e5-409e-bf33-bbe760b34bf7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:14.376965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=aa9aadf0069b45758a89cfb6a737082d, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:14.378353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:14.403919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 307/611] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:14 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/aa9aadf0069b45758a89cfb6a737082d/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:14.425720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:14.426568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.426847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.427117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.439131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:14.440592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:14.469850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:14.471996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:14.474134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:14.474134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:14.474134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:14.474134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:14.474134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 305/612] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:14.477917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:14.637451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:14.659259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7696d-f464-4c74-8bd5-cac81b578fb3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:14.713499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:14.714288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.714634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.714918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.715754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:14.716062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:14.717458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec6a2-16a3-4134-9935-c51b4d5cfe10 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:14.731905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 308/613] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:14.737760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:14.845563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:14.854548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ec2fa-866a-43ee-b4ad-98f55c19f2e7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.854911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ec2fa-866a-43ee-b4ad-98f55c19f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.855196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ec2fa-866a-43ee-b4ad-98f55c19f2e7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.857024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 309/614] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:14.862632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.862941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.863299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.874760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d797-0764-4dba-af4d-03eb4a9e3f6c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:14.887002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:14.889258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:14.940115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:14.941222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:14.941658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:14.942107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:14.959825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:14.961619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:14.970938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 310/615] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:14.993308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:14.994471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:14.995566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:14.998049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:14.998257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 306/616] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:15.012975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.099611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:15.127131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd21d0e-3bde-4973-b6f3-720e69ecbad5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.164291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.165019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.165367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.165737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.178329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:15.191485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:15.192748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:15.194555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 311/617] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:15.195646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.248854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec8cd9-62c3-4133-8ec3-c66fe45dd763 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.322694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.323678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.324128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.324556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.327423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:15.327953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:15.329570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:15.358337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:15.360919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2495e4-d7de-41ae-93de-89eec51d25b2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.371565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 307/618] 10.222.0.61 () {56 vars in 1135 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:15.374196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.426856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.428376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.428813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.429238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.430176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:15.430632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:15.432544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:15.446342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:15.457339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 312/619] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:15.462959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.562310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e59941-5052-4331-a552-8579149ce1f2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.618784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.619618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.619902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.620177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.632896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b7a24-7477-482c-ac43-9d5c62976e34 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.650906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:15.652516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:15.668993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.669799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.670115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.670393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.681310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:15.682747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:15.699372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:15.700352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:15.701283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:15.701283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:15.701283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:15.701283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:15.701283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 308/620] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:15.701885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:15.702781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:15.703686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:15.703686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:15.703686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:15.703686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:15.707403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 313/621] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:15.715073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.716399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.801758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:15.824016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:15.867186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439083b-04dd-42ed-8450-af02edec11cc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.873924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3db34-1e95-4693-9413-111755caa06f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:15.906275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.907298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.907761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.908245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.909235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:15.909344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:15.909828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:15.910041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.910329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.910603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.911327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:15.911635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:15.912436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c570c3-f3ab-45fa-8682-75ac70de2fc7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:15.916945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070325fa-a036-4654-8d86-68c2b53ab592 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:15.928534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 309/622] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:15.930377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d574a2-a57d-4872-ad2f-91f909d77d78 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.930856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d574a2-a57d-4872-ad2f-91f909d77d78 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.931375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d574a2-a57d-4872-ad2f-91f909d77d78 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.937527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 310/623] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:15.938769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 314/624] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:15.939048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d574a2-a57d-4872-ad2f-91f909d77d78 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:15.940123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:15.940414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:15.940689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:15.963890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:15.965162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:16.042001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 315/625] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:16.042001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.063633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d574a2-a57d-4872-ad2f-91f909d77d78 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.075753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.110160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.111585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.112851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.113509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.114156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.126662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.128415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:16.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:16.145666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:16.146898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:16.149019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 311/626] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:16.150132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.182880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1f503-89ad-4331-a534-e1ac763a99fa None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.228783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.229888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.230201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.230481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.240063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.241654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1eb091d2-6e7d-41a5-94c9-5d3b3bc4a686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:16.256336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:16.257525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:16.258461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 316/627] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:16.258963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f3c6-d595-4a7c-832f-b2d3c494b28c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.259088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f3c6-d595-4a7c-832f-b2d3c494b28c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.259358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8f3c6-d595-4a7c-832f-b2d3c494b28c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.260799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 317/628] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:16.261296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8f3c6-d595-4a7c-832f-b2d3c494b28c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.282824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afa27b-d916-4a76-a5d9-877b7bf40bb8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.320474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.321296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.321601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.321865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.334290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:16.342652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:16.343633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 312/629] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:16.350050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.377724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8f3c6-d595-4a7c-832f-b2d3c494b28c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.379166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.379409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.414208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.414879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.415163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.415435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.416261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:16.416565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.418110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe08c8-59a1-4def-8db8-9456786fa324 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.436337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 318/630] 10.222.0.61 () {56 vars in 1137 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:16.437590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.437874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.438175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.453820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:16.455012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:16.461074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037327-90ff-4fd8-af91-395250eaadf7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.499237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.499997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.501891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.501891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.501891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:16.501891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.503007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.515773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 313/631] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:16.516671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.541639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 319/632] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:16.542876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.626259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.638541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb147d-fc2f-49d5-b1eb-d908cfa984da None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.648826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.660173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbedd9-ffe0-49cd-b743-b8c70ba8e8cc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.674842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.675510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.675788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.676056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.676793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:16.677101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.678545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.686759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 314/633] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:16.687475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.701435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.702445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.702909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.703452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.778216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.779984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.793320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d46e-9fb6-41b8-b206-68111be8db87 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:16.827797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:16.828700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:16.828985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:16.829256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/effdc345daee49d8ad4a09f2dd6fd40e/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:16.845801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=effdc345daee49d8ad4a09f2dd6fd40e, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:16.847314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:16.858901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.864228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 315/634] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:16 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/effdc345daee49d8ad4a09f2dd6fd40e/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:16.864846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:16.897219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:16.915603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 320/635] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:16.916910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.013934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c49d-cb64-4361-957c-8e2be14e6a77 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.054963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.055944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.056214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.056495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.063450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4c545-3c51-4bad-8c1e-3c7406371b36 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.069665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:17.079818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.081042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 316/636] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:17.082071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.121853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.123676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.124129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.124571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.139399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.141621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.152744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:17.163297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:17.164468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:17.165615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:17.165615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:17.165615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:17.165615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:17.166502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 321/637] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:17.167463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.202799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8d7ca-c67c-47a4-ad75-267a8498bc4e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.216054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.239993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.241247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.241794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.242246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.253684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.255280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:17.274343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:17.275354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:17.276375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:17.276375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:17.276375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:17.276375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:17.276375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 317/638] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:17.276839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.292457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cf3a8-43de-489d-8674-7be912e5a829 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.334303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.335281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.335722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.335992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.336758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:17.337060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.338721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde7da7-e349-4c7d-8f13-55d75949ff25 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.348601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 322/639] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:17.349921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128e0b2-6194-4615-8edb-dd747fd9a9e7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.350238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128e0b2-6194-4615-8edb-dd747fd9a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.350510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128e0b2-6194-4615-8edb-dd747fd9a9e7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.354010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 323/640] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:17.354010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128e0b2-6194-4615-8edb-dd747fd9a9e7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.391920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b51cc-d36a-422b-8871-dc94645f5f93 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.405428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.429696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.430419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.430702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.430986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.431708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:17.432016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.433398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.448563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 318/641] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:17.450019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.468762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128e0b2-6194-4615-8edb-dd747fd9a9e7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.472216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.512828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.514008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.514537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.514757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.515503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:17.515810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.517342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30d847-1505-4946-938c-ca85f57197e5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.531689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 324/642] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:17.533041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.533334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.533611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.552368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:17.556720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:17.593041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8652f-4e93-406e-a17e-662b43544461 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.632620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.633457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.633735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.634036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.638012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 325/643] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:17.638012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.654003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.655727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:17.676069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:17.677290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:17.678444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:17.678444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:17.678444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:17.678444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:17.680030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 319/644] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:17.680984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.713210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.758506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.766877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60e41b-6c35-4077-a650-484580aa20e9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.801576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dd06-d086-4497-8370-e342d3596c3c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.804025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.804842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.805125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.805399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.813025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.814587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:17.829281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:17.830348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 326/645] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:17.831429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.845475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.846334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.846610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.846884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.854265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:17.855717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:17.870100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:17.871013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 320/646] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:17.877077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:17.940842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced1b2-32eb-4aaa-b13c-c57e4f1c334c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.963429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:17.976850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:17.977649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:17.977997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:17.978403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:17.986578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb9ac-8a5d-46c3-80eb-8403236eda83 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:17.989706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:17.998428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:17.999574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:18.001201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:18.004468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 327/647] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:18.005593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.025816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.039698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.040379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.040657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.040927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.041647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:18.041952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.043677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.056590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 321/648] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:18.057347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.147650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53a5a-ee04-474a-9f9b-05195a04b9cc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.184919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.185857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.186544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.186758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.187751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:18.188015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.189757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.196981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5c134-4701-4540-b41d-952b31d87dd0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.207796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 328/649] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:18.209314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.256009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.256826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.257464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.257753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.258849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:18.259167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.261080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.274126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 322/650] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:18.274944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.281085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.293804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.330480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab918b0-b2d1-4cec-8242-d2169cddb07f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.367946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.368898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.369334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.369758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.370687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:18.371143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.372670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.381930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 329/651] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:18.382738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.392241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fa899-f352-405d-aa02-7b56b59af105 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.426676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.427584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.428400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.428678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.436627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.438102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:18.452572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:18.453593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 323/652] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:18.454574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.496918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9438d-e98c-443b-ad24-c618540697bc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.531835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.538144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.538819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.539101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.539373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.542225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.575432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9672a-ac07-4302-b015-0b04bde0282e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.610959 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.611640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.611818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.612090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.612912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=b8bc75da330c48aab2b15609eb495cc0) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:18.613219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.614704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.616138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.617571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.622283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 324/653] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/role_assignments?user.id=b8bc75da330c48aab2b15609eb495cc0&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:18.623094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.746356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d86fd-6f0b-46ee-9bba-2b4d4afc54b4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.777742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.783200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 330/654] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:18.785167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.787547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.788389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.788674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.788965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.803069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.804407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:18.824416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:18.825403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:18.826352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:18.826352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:18.826352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:18.826352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:18.826352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 325/655] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:18.827070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:18.836514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:18.923052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2c984-091b-4070-8d00-9c8094f4cfc0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.957327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516539a9-209c-4151-b420-6b3dca17cd81 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:18.968831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:18.969784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:18.970099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:18.970374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:18.971613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:18.971931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:18.974402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:18.997952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 331/656] 10.222.0.61 () {56 vars in 1137 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:18.998924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.005277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.007036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.007535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.008017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.022588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.025222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:19.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:19.055372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:19.056288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:19.056288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:19.056288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:19.056288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:19.059066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 326/657] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:19.060197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.097795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.112448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.123867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e05754-4db8-491d-bd6f-d041ee479a46 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.163314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.163994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.164279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.164555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.165387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:19.165700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.167239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.180199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a56ed4-4c3c-4902-b14f-027ada7ea21d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.193756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 332/658] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:19.195474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.239574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c2f74-86d8-40ef-b1c6-ddcff42e5f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.240997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c2f74-86d8-40ef-b1c6-ddcff42e5f51 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.241663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c2f74-86d8-40ef-b1c6-ddcff42e5f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.242331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c2f74-86d8-40ef-b1c6-ddcff42e5f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.330916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c2f74-86d8-40ef-b1c6-ddcff42e5f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.332390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c2f74-86d8-40ef-b1c6-ddcff42e5f51 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.339163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d19759-2aea-43a5-9da2-e2371bafecbe None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.364762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.377109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.378335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.378783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.379066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.379794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:19.380101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.382106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.399487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 333/659] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:19.399487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.411680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.445991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 327/660] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:19.447594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0948fc-79ae-4a13-b9d7-97f36b8a45aa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.447880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0948fc-79ae-4a13-b9d7-97f36b8a45aa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.448153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0948fc-79ae-4a13-b9d7-97f36b8a45aa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.449684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 328/661] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:19.450346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0948fc-79ae-4a13-b9d7-97f36b8a45aa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.518703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2f75-e8a8-4dd5-a33e-e34973f74739 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.560574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.561374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.561658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.561926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.570101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.570281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0948fc-79ae-4a13-b9d7-97f36b8a45aa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.571561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-df38bbd2-e4be-4d66-9bd0-dc4dd26cc53c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:19.588403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:19.589454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:19.590456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 334/662] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:19.591087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.592027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.592027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.611178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.617534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.618372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.618656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.618931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.622054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:19.623115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:19.627051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.628530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:19.644107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:19.645165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 329/663] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:19.651012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.705298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 335/664] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:19.706235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.709387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.774982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745abfd-b0fb-49bf-8c82-0beb1bb01767 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.813349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.814180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.814461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.814742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.818101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9897-0a94-402f-ac20-6c075629dd5f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:19.825833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.827720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:19.847080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:19.848100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:19.849010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:19.849010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:19.849010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:19.849010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:19.849010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 330/665] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:19.850775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.861205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:19.861895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:19.862211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:19.862492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:19.863339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:19.863659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:19.865155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:19.889473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 336/666] 10.222.0.61 () {56 vars in 1139 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:19.890395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:19.901824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.960234 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:19.968579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817460c-9088-422e-a344-2d7336a4d1c9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.010091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839c6a8-aeb9-412b-a47f-59d4b5400b90 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.010636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.011352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.011640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.011959 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.012765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:20.013081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.014671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.029990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 331/667] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:20.030851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.073837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.075358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.076058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.076739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.096425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:20.110258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:20.112165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:20.113757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 337/668] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:20.116549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.209723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981661-9bd5-4f04-8712-433e640340e1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.214100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:20.246553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7fa49-e26e-4bd5-8610-1da375d6d0ee None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.265915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.267023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.267500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.267970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.269238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:20.269760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.272748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.283702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:20.291353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 332/669] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:20.293172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.309256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.310340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.310627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.310905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.389213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.390870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.410448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e283-7730-4e47-9115-158f51887dcf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.445805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.446495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.446775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.447049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.447867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=9799f9d11546403e8b46ad386be470d8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:20.448178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.449624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.466076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 333/670] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/role_assignments?user.id=9799f9d11546403e8b46ad386be470d8&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:20.466076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.509374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:20.527532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 338/671] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:20.528511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.555589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:20.628053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310f053-1455-4b96-bae1-e0eee82465e6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.667926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11565-c389-4e16-9d85-b7909f4f0b11 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.671619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.672543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.672921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.673346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.674269 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:20.674684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.676239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.685891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 334/672] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:20.686941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.723370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.724128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.724448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.724723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.734108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.735598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:20.750445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:20.751420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:20.752427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 339/673] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:20.752924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.816028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:20.827790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb7e3-74f5-4d3d-8d9b-178d4483c399 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.867682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:20.877864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.879513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.879805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.880487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.894113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3579f4-019e-4c44-acdb-7037fcd858da None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:20.897254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.899267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:20.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:20.928095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:20.928985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:20.928985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:20.928985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:20.928985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:20.929641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 335/674] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:20.934256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:20.936766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:20.937577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:20.937856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:20.938159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:20.953216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:20.955516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:20.994475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:20.996973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:20.999074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:20.999074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:20.999074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:20.999074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:20.999074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 340/675] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:20.999074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.060276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f6b20-8e7b-4213-a8dc-974b50edb922 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.096481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.097149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.097427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.097700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.098507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:21.098820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.100936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.105307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bda4f-fc48-4987-af66-44200c9e7b13 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.118014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 336/676] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:21.118014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.121264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:21.141802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:21.148514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.149373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.149757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.150063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.150669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:21.150989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.152394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140e51-b259-4ca6-a0c4-594843163f48 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.170489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 341/677] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:21.171879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7da91-efe7-4d39-905e-ee47df538968 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.172173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7da91-efe7-4d39-905e-ee47df538968 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.172450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7da91-efe7-4d39-905e-ee47df538968 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.173787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 342/678] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:21.174452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7da91-efe7-4d39-905e-ee47df538968 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.251834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b2f02-e0eb-4ae4-b0a9-c8460f3b9957 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.288989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.289657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.289943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.290252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.291001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:21.291278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.292672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.310225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 337/679] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:21.310225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.311295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7da91-efe7-4d39-905e-ee47df538968 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.352877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.354342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.354772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.355674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.356664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=2f646e6869e44b20adf102b964394512) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:21.357429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.359494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee4f9-0964-4674-a6ce-629cceb51d24 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.368877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 343/680] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/role_assignments?user.id=2f646e6869e44b20adf102b964394512&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:21.370858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.371530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.371967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.382350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:21.397585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:21.400220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:21.425852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbea59-fae5-45a8-a3df-bad36dddde92 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.473007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.473879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.474750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.475027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.480021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:21.485472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.486584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.503961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 344/681] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:21.504403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:21.505290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:21.506280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:21.506717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.511028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 338/682] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:21.511262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.624758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc9dcd-ca9b-41b9-b817-1ad867ea558a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.625137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12dc4-63bd-428a-ac42-1a520f13f79a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.662094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:21.667820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.668647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.668930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.669353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.675845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.676515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.676797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.677073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.677918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:21.678261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.678588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.679727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.680043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.694268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 339/683] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:21.695018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:21.697149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:21.698138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:21.699125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 345/684] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:21.706490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.775293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:21.827337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750aeefd-2c8f-4135-9c5d-384de922045d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.853997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ba23-d9b6-4ea6-963e-5b5c6f8e4f5c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:21.866711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.867539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.867816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.868090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.868748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.870157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:21.885368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:21.886675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:21.887691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 340/685] 10.222.0.61 () {56 vars in 1129 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:21.888566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.893671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:21.894584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:21.895029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:21.895446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:21.896469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:21.896919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:21.899105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:21.923695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 346/686] 10.222.0.61 () {56 vars in 1135 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:21.925114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:21.949988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:22.016796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d4bd2-1362-48ce-b723-9a6980c44d06 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:22.063655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005835c-314e-4506-b7c8-80b8adb034c5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:22.064094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:22.064805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:22.065359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:22.065640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:22.066999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:22.069384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=aa9aadf0069b45758a89cfb6a737082d) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:22.069901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:22.071525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:22.086616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 341/687] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/role_assignments?user.id=aa9aadf0069b45758a89cfb6a737082d&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:22.086616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:22.131521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:22.132205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:22.132482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:22.132749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:22.133455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:22.133753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:22.135202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:22.143214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 347/688] 10.222.0.61 () {56 vars in 1124 bytes} [Fri May 27 03:10:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:22.149837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:22.313086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079d149-f00f-468e-aa0a-ff628011215b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:22.329247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:22.358841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848373-d0e4-448e-926b-23c75c537220 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:22.363996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:22.364658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:22.365527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:22.365799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:22.404526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:22.406147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:22.406618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:22.407074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:22.407969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:22.408475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:22.411113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:22.419299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 348/689] 10.222.0.61 () {56 vars in 1124 bytes} [Fri May 27 03:10:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:22.453023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:22.454686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:22.586020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 342/690] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:22.592198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:22.644502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:22.728824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9b75-cb78-4b31-a134-921db69ba811 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:22.790507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:22.791322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:22.791598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:22.791866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:22.805142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:22.806646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:22.827107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:22.828075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:22.828988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:22.828988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:22.828988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:22.828988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:22.828988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 349/691] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:22.834778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:22.847278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:22.983668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e088-0a9e-4238-881b-dee8b8338ffc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:23.041359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:23.042119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.042405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.042687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.043420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:23.043742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:23.045183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362e99-a651-41eb-bc10-f2a39aabb746 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:23.062471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 343/692] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:23.068510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:23.169435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ec31-ec1c-4299-bf65-afeed38b4d57 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.169684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ec31-ec1c-4299-bf65-afeed38b4d57 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.169922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ec31-ec1c-4299-bf65-afeed38b4d57 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.171754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 344/693] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:23.179538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.179814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.180096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.222345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:23.231772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264e7b-7230-48df-8b38-46ff95a52585 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:23.237893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:23.239143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:23.283993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:23.284782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.285041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.285613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.293413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:23.295103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:23.318424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:23.319399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:23.320310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 350/694] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:23.324145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:23.408241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:23.418235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 345/695] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:23.454958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:23.562253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14d58-4acc-4d8e-afca-47c325c27e46 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:23.626402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef22dce-17cb-4275-a92a-e8b92ffbfa86 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:23.638698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:23.639380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.639657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.639928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.640728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:23.641031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:23.642536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:23.668196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 351/696] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:23.671004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:23.678380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:23.709384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:23.710135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.710411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.710679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.738081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:23.746508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:23.747546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:23.748398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:23.755034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 346/697] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:23.761256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:23.800844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8e04-2925-4804-a8f6-6cc808ed8923 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:23.867832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:23.868507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:23.868784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:23.869051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:23.869947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=effdc345daee49d8ad4a09f2dd6fd40e) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:23.870305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:23.872129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:23.884741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 352/698] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:23 2022] GET /identity/v3/role_assignments?user.id=effdc345daee49d8ad4a09f2dd6fd40e&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:23.885995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:23.957639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d6303-faf6-46d0-af66-ae1618120024 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.007986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.008582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.008863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.009138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.009889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:24.010218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.011594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb755f8-5843-4ad6-be90-ca8e6c890d1b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.026977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 347/699] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:24.032607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.037954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c575a9-5fb5-41ce-981a-db8c5b917d9e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.037954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c575a9-5fb5-41ce-981a-db8c5b917d9e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.037954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c575a9-5fb5-41ce-981a-db8c5b917d9e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.038691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 348/700] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:24.043686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.044287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.044765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.078270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:24.081675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:24.161202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:24.195594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 349/701] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:10:24.211751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc41d7-cd5d-4764-80dc-a8d3cb76242f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.229791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.252381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.253188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.253466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.253737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.269059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.270538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.292047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:24.292995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:24.293874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:24.295435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:24.295435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:24.295435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:24.295435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:24.295435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 353/702] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:24.299840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.353324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf615-08cf-4663-baa4-f5bfc4bae2b5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.396904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.398283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.398775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.399387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.413090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.415093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.423270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516529-6520-4703-83cb-b00e1a0d16c2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:24.438063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:24.439069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:24.440072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:24.440072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:24.440072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:24.440072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:24.445746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:24.446698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 350/703] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:24.450922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.461454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.462167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.462449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.462723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.463443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:24.463746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.465624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.484507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 354/704] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:24.491698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.625722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b860e7d-3b85-4a42-ba75-49f53ee4c62a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.666717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.667949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.668229 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.668502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.677340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.678984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.680331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e8731-c975-4f82-a2d0-c579ef159553 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.687884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:24.698473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:24.699502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:24.700782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 355/705] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:24.705598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.762412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:24.810472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.811222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.811507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.811781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.812513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:24.812821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.814233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.821349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27623b73-e5d4-4207-9aea-c4aabd29871e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:24.844549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 351/706] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:24.850935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:24.858506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:24.859183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:24.859462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:24.859733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:24.860570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:24.860874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:24.862425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:24.885235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 356/707] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:24.891282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:25.022828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927acd1-f075-4519-b839-e4cf7edfbb9f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:25.097546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0ff1-dd8a-4228-8a19-840a45cfd7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:25.098863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0ff1-dd8a-4228-8a19-840a45cfd7f5 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.100490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0ff1-dd8a-4228-8a19-840a45cfd7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.100999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0ff1-dd8a-4228-8a19-840a45cfd7f5 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.102858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e0ff1-dd8a-4228-8a19-840a45cfd7f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:25.106038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e0ff1-dd8a-4228-8a19-840a45cfd7f5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:25.109358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:25.122515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85fc9-e979-40ee-8058-af8f915fe1b8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:25.170531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 352/708] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:10:24 2022] POST /identity/v3/users => generated 254 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:25.177322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:25.178421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.178937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.179486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.264759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:25.266628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:25.343513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6de8-7dc3-47a7-a129-d1c8b6953f87 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.343845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6de8-7dc3-47a7-a129-d1c8b6953f87 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.344391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6de8-7dc3-47a7-a129-d1c8b6953f87 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.350100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 353/709] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:25.351559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efefbfd-d140-4241-bd10-27afb378f44f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.351850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efefbfd-d140-4241-bd10-27afb378f44f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.352135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efefbfd-d140-4241-bd10-27afb378f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.391163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6efefbfd-d140-4241-bd10-27afb378f44f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:25.392408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6efefbfd-d140-4241-bd10-27afb378f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:25.394859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:25.398632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 357/710] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:25.412553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:25.414737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:25.533883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 354/711] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:25.536318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc3396-a744-43e9-a706-a52355bdd8d7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.538948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc3396-a744-43e9-a706-a52355bdd8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.539455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc3396-a744-43e9-a706-a52355bdd8d7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.541707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 355/712] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:25.549085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.549669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.550189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.556348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4b86e-812a-4504-894c-76e41f8ba96a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:25.573060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:25.574348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:25.600170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:25.600971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.601256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.601524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.612747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:25.614257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:25.633659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:25.635490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:25.636692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:25.636692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:25.636692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:25.636692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:25.636692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 358/713] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:25.636692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:25.649860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 356/714] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:25.650771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:25.713424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:25.739363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:25.761260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199687-52d8-4e7e-a966-b8cbc65340b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:25.768813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563bb88-f3c6-495b-9ee2-90ebec65a271 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:25.798847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:25.799521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.799802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.800078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.800806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:25.801108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:25.802564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:25.807130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:25.807898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.808222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.808512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.809301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:25.810697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:25.815864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 357/715] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:25.816948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:25.834146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 359/716] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:10:25 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:25.835453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:25.951633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfa7ae-da53-445d-aa3a-865fde7238e3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:25.986100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:25.986909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:25.987188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:25.987462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] PATH_INFO: `/v3/services/network` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:25.988283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:25.989759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:26.006275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:26.007765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:26.008625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 358/717] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:25 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:26.013812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:26.086357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2024-f718-4f88-a3b5-c439e4a1a5fe None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:26.100709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:26.135892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:26.136707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.136987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.137255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.145602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:26.148087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:26.168506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:26.169925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:26.170874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 360/718] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:26.177675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:26.217993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4b7c-9aa4-41c1-b91d-f1903226b467 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:26.269757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:26.270386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.270667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.271553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.272355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] RBAC: Adding query filter params (name=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:26.272659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:26.274380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:26.282488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 359/719] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:26.291308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:26.323126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da14719-013b-4b47-b276-e7ca7f606801 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:26.363125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:26.363826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.364107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.364382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.365861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:26.366363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:26.367841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:26.378017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:26.384004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 361/720] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:26.390640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:26.425839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490484f-ba88-416b-ba95-d26ab0b705bf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:26.469328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:26.490724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:26.491666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.492098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.492517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.493375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:26.493856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:26.495469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d22ce-72dc-4c58-947d-c1a94d01cfcd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:26.513228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 360/721] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:26.590885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e745513-bcbe-4f55-ab89-d0eeda37638e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:26.647984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:26.648772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.648959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.649237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.650139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=9799f9d11546403e8b46ad386be470d8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:26.650463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:26.651970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bd1ab-1e93-451a-8879-195e9cb2adb7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:26.658791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 362/722] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:26 2022] GET /identity/v3/role_assignments?user.id=9799f9d11546403e8b46ad386be470d8&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:26.818673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933515df-9c48-4b67-a69f-808c596c6daa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.819023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933515df-9c48-4b67-a69f-808c596c6daa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.819235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933515df-9c48-4b67-a69f-808c596c6daa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.820938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 361/723] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:26.826807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:26.827152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:26.827368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:26.847177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:26.848364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:26.926844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 363/724] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:26.969517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933515df-9c48-4b67-a69f-808c596c6daa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:27.104053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933515df-9c48-4b67-a69f-808c596c6daa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:27.138402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:27.153459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:27.154303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:27.154589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:27.154865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:27.171242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:27.179593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:27.180555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:27.181427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 362/725] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:27.187242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:27.250893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:27.332920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2d88f-f13d-4769-8dce-35b521b1ab6a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:27.379271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:27.379876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:27.380717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:27.381012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:27.381766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:27.382101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:27.383499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:27.399042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:27.402431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 364/726] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:27.584140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a758b-6d4d-4c43-bec4-0849be7edaeb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:27.639678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:27.640420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:27.640689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:27.640965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:27.658852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:27.660330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:27.683098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:27.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:27.684976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:27.684976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:27.684976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:27.684976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:27.688998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 363/727] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:27.694937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:27.819567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:27.834836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157d53-79ab-45aa-ab34-daaf8b9a3324 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:27.872695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:27.873451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:27.873738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:27.874095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:27.874850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:27.875160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:27.876572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7a7c2-f417-4416-b931-165f2c244b81 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:27.894157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 365/728] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:27.896149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:27.939163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:28.019296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5fc2-2382-4be9-9469-92f4981bbc52 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:28.044002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9439833-71bb-4626-8dd1-0fa0404d8e41 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.044331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9439833-71bb-4626-8dd1-0fa0404d8e41 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.044588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9439833-71bb-4626-8dd1-0fa0404d8e41 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.046011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 366/729] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:28.057268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.057560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.057840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.075582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:28.076399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.076684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.076960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.086692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:28.087903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:28.095002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:28.096463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:28.130158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:28.131823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:28.132865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 364/730] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:28.138554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:28.206067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 367/731] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:28.233379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:28.347227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:28.354348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:28.359436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e4dd-9e86-4c45-9438-26b49b6e7532 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:28.382145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e8531-deb7-49c0-966e-1ff5015b8c8d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:28.420556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:28.421371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.421656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.421935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.434758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:28.443922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:28.444935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:28.445798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:28.450226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 368/732] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:28.451504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:28.466560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:28.467868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.468453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.469165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.470352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:28.470874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:28.472544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:28.521488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 365/733] 10.222.0.61 () {56 vars in 1135 bytes} [Fri May 27 03:10:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:28.526755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:28.569804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1313f-4b9e-4e6f-aebe-8700ab31007a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:28.610272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:28.611309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.611607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.611889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.612680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:28.612995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:28.615131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:28.618201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:28.631260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 369/734] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:28.634620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:28.749440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d65b-5717-4ad9-8c03-44061def4f32 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:28.808372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b936-b7a6-47f6-8733-3b26dee3587f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:28.848212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102b58-4324-4100-a108-6080c64d4505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:28.849442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102b58-4324-4100-a108-6080c64d4505 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.849734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102b58-4324-4100-a108-6080c64d4505 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.850033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102b58-4324-4100-a108-6080c64d4505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.887390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:28.935021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102b58-4324-4100-a108-6080c64d4505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:28.937046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102b58-4324-4100-a108-6080c64d4505 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:28.939222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:28.940306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.941526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.941901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.955657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:28.957412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-205b41f3-eeb7-44e6-81e2-b74d6f4325ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:28.980741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:28.981929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:28.983109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:28.983109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:28.983109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:28.983109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:28.988339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 370/735] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:28.990155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9b53-1360-4372-b9b0-cbdc10fce78e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:28.990442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9b53-1360-4372-b9b0-cbdc10fce78e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:28.990714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9b53-1360-4372-b9b0-cbdc10fce78e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:28.996468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 371/736] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:28.997533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f9b53-1360-4372-b9b0-cbdc10fce78e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.063135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.079324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 366/737] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:10:29.079324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.079324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.079324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.108681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:29.110294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:29.132146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f9b53-1360-4372-b9b0-cbdc10fce78e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.183560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.185857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.187676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.188182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.189619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.191476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:29.192345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.196854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.210312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 367/738] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:29.211602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.229403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 372/739] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:29.234759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.366423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbde9d-b62e-4616-8633-ebaf9040d6ad None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.385447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55a556-d19d-43cb-8edd-90157b789031 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.398004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.405182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.406027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.406313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.406882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.419213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.420739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.427790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.429278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.429569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.429843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.439047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.440508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:29.440615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:29.441442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:29.442462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:29.442462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:29.442462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:29.442462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:29.442462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 368/740] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:29.443898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-039807ab-0bb6-497f-ab50-e9e073397655 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:29.462082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:29.463112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:29.464082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 373/741] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:29.466182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037eee2-aa85-47ff-8e68-40ff4a88ec21 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.466581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037eee2-aa85-47ff-8e68-40ff4a88ec21 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.467060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037eee2-aa85-47ff-8e68-40ff4a88ec21 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.474983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 374/742] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:29.474983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037eee2-aa85-47ff-8e68-40ff4a88ec21 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.496764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.566143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a28dc-3bd3-4c93-8ef7-9b9608aa2fe3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.601406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037eee2-aa85-47ff-8e68-40ff4a88ec21 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.606359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.607192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.607465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.607743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.608657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.610074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:29.623037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:29.624182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:29.625055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:29.626534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 369/743] 10.222.0.61 () {56 vars in 1129 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:29.627563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.640374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.641039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.641314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.641585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.642341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:29.642639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.643992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c388670-f6d3-4487-8b3c-973ab17fb5b3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.655745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 375/744] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:29.657066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537654-5b12-49df-9c88-aa55f6af8132 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.657356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537654-5b12-49df-9c88-aa55f6af8132 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.657630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537654-5b12-49df-9c88-aa55f6af8132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.675957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-05537654-5b12-49df-9c88-aa55f6af8132 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:29.677174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-05537654-5b12-49df-9c88-aa55f6af8132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:29.701018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.733130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc5c63-dd02-4694-b609-f6ef9b5816ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.735468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.747258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 376/745] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:29.748472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519009c-8134-4d10-996b-dd1dde43b3e5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.748760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519009c-8134-4d10-996b-dd1dde43b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.749042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519009c-8134-4d10-996b-dd1dde43b3e5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.750587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 377/746] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:29.755747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519009c-8134-4d10-996b-dd1dde43b3e5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.775683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.776371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.776650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.776927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.777771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:29.778115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.779593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.799251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 370/747] 10.222.0.61 () {56 vars in 1149 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:29.800395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:29.868817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519009c-8134-4d10-996b-dd1dde43b3e5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.906887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd0c7b-9be9-40b6-a7e9-836062534f91 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:29.908703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.909365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.909638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.909902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.910635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:29.910934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.912857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d40f-fa0f-43ec-89c8-a2ca33cbf45f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.917439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 378/748] 10.222.0.61 () {56 vars in 1124 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:29.918676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.918956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.919226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.935769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:29.936978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:29.948475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:29.949271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:29.949556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:29.949830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:29.954754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:29.956954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:29.959108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:29.973288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:29.974489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 371/749] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:29.980405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.000685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.006783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 379/750] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:10:30.007633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.090960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59591c2-4e9b-4059-957f-d87d141141a6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.107474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df0cd8-48b4-4617-9cb1-276ab3345d28 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.124066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.124722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.124997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.125266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.125988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.127358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.141753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 372/751] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:10:29 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:30.142677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.163865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.164446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.164719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.164990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.189001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.237850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.252261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.253828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.263367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29137f2-e716-4249-baf5-230bfcb512bb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.303028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.303714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.303997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.304272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.304991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:30.305299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.306748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.316933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 373/752] 10.222.0.61 () {56 vars in 1124 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:30.316933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.371405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 380/753] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:10:30.372618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.424247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.434393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61566f3d-3115-4382-b54c-ca7996b49831 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.469513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.470391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.470674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.470950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.471733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:30.472042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.473503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.478251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad1a6-c442-4e95-9ee5-ae19cb105d9f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.492455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 374/754] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:30.493310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.502587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.522054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.522978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.523255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.523527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.534171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:30.542542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:30.543520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:30.544377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 381/755] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:30.546084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.610661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cf1c5-a336-46f0-b0dd-79159e207cdf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.649023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.649695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.649999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.650280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.651066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] RBAC: Adding query filter params (interface=public, service_id=8bd2ea69411a478f824c295a999a53b5, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:30.651379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.651480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed53fa-888f-41df-b914-70a09826a326 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.652757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.666018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 375/756] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/endpoints?service_id=8bd2ea69411a478f824c295a999a53b5&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:30.666018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.668797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.695915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.696639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.696924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.697202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.709288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.710639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:30.729560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:30.730566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:30.731505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:30.731505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:30.731505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:30.731505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:30.731505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 382/757] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:30.731800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.744274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:30.778735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d63c6-cede-4ba6-966d-bed636e76c2b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.814238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.815013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.815297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.815566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.816388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=effdc345daee49d8ad4a09f2dd6fd40e) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:30.816694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.818181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.824393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 376/758] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/role_assignments?user.id=effdc345daee49d8ad4a09f2dd6fd40e&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:30.825474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.857376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0b98f-7705-4ddc-8138-1663c54d2303 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.907987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:30.909231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:30.909585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:30.909927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:30.911134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:30.911519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:30.913081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:30.925938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 383/759] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:30.927583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:30.956146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a854c1-25a3-421e-8b91-f0e35b989c6c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:30.963205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:31.001609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.002449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.002799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.003139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.004645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.007180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.008855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:31.015705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 377/760] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:31.018937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:31.073661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a74a1-2554-426c-b462-5212e4e08719 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.136320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.137005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.137282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.137554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.138310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:31.138615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.140030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.162428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 384/761] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:31.169635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:31.244960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4770ce-56c3-43fa-8a5b-4f8fc5d7c271 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.287073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.288041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.288453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.288815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.303739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.305271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.317388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:31.329757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:31.330746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:31.331691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:31.331691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:31.331691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:31.331691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:31.336761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 378/762] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:31.337812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:31.338962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb38f71-a234-4460-990c-6ad88713e3ee None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.398486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.399304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.399580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.399851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.413679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.415485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.438369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:31.445434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:31.446439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:31.447353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:31.451585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 385/763] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:31.452938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:31.487127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ed20-f34a-4e7d-8301-aa974b5fb4c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.585056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c226188-55d7-4c30-ab27-ef86d7951291 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.595673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.597005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.597498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.597993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.599554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:31.600067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.601668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.614432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 379/764] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:31.620174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:31.634458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.635449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.636009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.636548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.637542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:31.639915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.641664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.666936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 386/765] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:31.673300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:31.679060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:31.813885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dcacf-167a-4ced-964f-3a6cf6e59f84 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.821432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313818b-9fed-4324-be3c-2bb18570d68a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:31.838325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:31.881124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.881828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.882086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.882357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.883185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=6af8f930d4e94212896840b336e6f9cf) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:31.883491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.884915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.888192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:31.888982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:31.889258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:31.889522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:31.898345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:31.899791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:31.902948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 387/766] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/role_assignments?user.id=6af8f930d4e94212896840b336e6f9cf&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:31.918823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:31.919884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:31.920845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 380/767] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:31.930038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:32.074339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:32.143246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcdff3-0767-4185-864d-12b30b7668e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:32.194779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:32.195938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:32.196424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:32.196896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:32.198046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:32.198580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:32.200286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:32.232313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 388/768] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:10:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:32.237888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:32.390620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d952e7-f425-445c-b4af-5c39a740bff8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:32.440913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:32.441621 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:32.441955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:32.442303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:32.459755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:32.461242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9b19411f-30be-4d18-9ea5-3728271a0b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:32.483884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:32.484843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:32.485747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:32.485747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:32.485747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:32.485747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:32.485747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 381/769] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:32.497218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:32.637117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a6f0-232b-4463-a177-cfc4ea304167 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:32.637638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a6f0-232b-4463-a177-cfc4ea304167 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:32.637638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a6f0-232b-4463-a177-cfc4ea304167 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:32.639254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 382/770] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:32.646744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:32.647029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:32.647303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:32.661881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f272189-042d-404e-a98a-c703797bd3d2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:32.683457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:32.684697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:32.713038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:32.727941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:32.735373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:32.736076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:32.736360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:32.736637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:32.737395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:32.737704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:32.739331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:32.771891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 389/771] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:32.776248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:32.838992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 383/772] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:32.887589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:32.947293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dede73-be5e-4c58-b6a4-e5aa58e1ba61 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.018888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.019607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.019882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.020156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.033073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.034624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:33.049753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:33.050717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:33.051643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 390/773] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:33.060715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:33.088262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ce71-807c-4d53-a598-a5efbf4a1cbd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.142326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:33.158077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.158884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.159204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.159484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] PATH_INFO: `/v3/services/network` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.160136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.162156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:33.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:33.175191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:33.176034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 384/774] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:32 2022] GET /identity/v3/services/network => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:33.185374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:33.217895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:33.257701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44368-86d2-4f1b-a8ad-15104547a4a7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.322383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dfb5e-d30c-4185-8044-06808ee67f68 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.362497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.363167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.363448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.363727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.365081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] RBAC: Adding query filter params (name=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:33.365385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.366791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.371647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.372287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 385/775] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:33.372400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.372596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.372869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.373671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:33.374001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.375458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.381201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:33.390367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 391/776] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:33.399705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:33.482355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:33.505582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69832-05eb-48e2-8a4c-e8808cb20220 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.573393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.574079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.574398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.574686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.575418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:33.575724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.577165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.589739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 386/777] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:33.597729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:33.627818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66a8c-e1dc-4322-ae93-355c7d0d0d83 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.640748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:33.675407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf4458-742b-4a07-84d1-2c2cb48239a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.676304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4458-742b-4a07-84d1-2c2cb48239a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.676608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4458-742b-4a07-84d1-2c2cb48239a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.676914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4458-742b-4a07-84d1-2c2cb48239a7 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/9799f9d11546403e8b46ad386be470d8/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.685259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf4458-742b-4a07-84d1-2c2cb48239a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=9799f9d11546403e8b46ad386be470d8, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.686820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf4458-742b-4a07-84d1-2c2cb48239a7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.716571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 392/778] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:33 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/9799f9d11546403e8b46ad386be470d8/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:33.771430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e2f9-8302-4887-ac8d-cf5e7c6f099a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.782388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa697fe4-ab1b-4dde-be5e-4b8a5d01f3ec None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.782709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa697fe4-ab1b-4dde-be5e-4b8a5d01f3ec None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.782959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa697fe4-ab1b-4dde-be5e-4b8a5d01f3ec None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.784721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 393/779] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:33.790454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e278811-5a90-4374-8dc5-f4d672b369ea None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.790741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e278811-5a90-4374-8dc5-f4d672b369ea None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.791019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e278811-5a90-4374-8dc5-f4d672b369ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.809908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.810622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.810906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.811179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.811976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] RBAC: Adding query filter params (interface=public, service_id=4e3101fcf2e54bc39f538ca41f6528dc, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:33.812284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.813745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:33.820870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 387/780] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:10:33 2022] GET /identity/v3/endpoints?service_id=4e3101fcf2e54bc39f538ca41f6528dc&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:33.825380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5e278811-5a90-4374-8dc5-f4d672b369ea None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:33.826548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5e278811-5a90-4374-8dc5-f4d672b369ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:33.829053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:33.847068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:33.950967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2cf69-49b7-41b3-8ceb-76ce7dbc83d1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:33.953134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 394/781] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:33.992987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:33.993730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:33.994035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:33.994351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:33.995035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:33.996421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:34.000596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe775a-49ef-4ad1-a43a-6510712657cb None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.001082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe775a-49ef-4ad1-a43a-6510712657cb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.001566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe775a-49ef-4ad1-a43a-6510712657cb None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.002719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 388/782] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:10:33 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:34.003597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.012731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 395/783] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:34.031330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.031821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.032306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.060943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:34.062872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:34.092969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:34.136568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c766a30-25ad-4675-88e2-717e3a8e0b58 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:34.156726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 396/784] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:34.185661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:34.186514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.186974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.187264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.189140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.209997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:34.216001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:34.216975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:34.217849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 389/785] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:34.224628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.250487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:34.372423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948e6e-7a31-4ac9-8b94-4cd061f97767 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:34.409829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:34.410706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.411521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.411795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.412453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:34.413841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:34.429381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:34.431615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:34.433285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 397/786] 10.222.0.61 () {56 vars in 1129 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:34.439673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.462890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88aea-d6af-4a20-b145-3cd67ef7d169 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:34.506751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:34.522008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:34.522008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.522008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.522008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.522662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:34.522662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:34.522662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:34.537441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 390/787] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:34.543307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.665131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:34.692042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e36476-f5cf-4dc8-9c18-7ccb796428f6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:34.708897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08c250-3e01-43d5-8bab-ccab394cbabf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:34.744838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:34.745632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.745919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.746227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.757424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:34.758934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:34.781047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:34.782481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:34.783724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:34.783724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:34.783724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:34.783724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:34.783724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 391/788] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:34.789152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.810037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:34.810725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.811012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.811636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.812011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:34.812321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:34.813717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971ed98-69e7-469f-ac97-8c9e43e60582 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:34.832257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 398/789] 10.222.0.61 () {56 vars in 1124 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:34.836520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827f6f-424a-4de7-83d4-26f57c133b9f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.836520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827f6f-424a-4de7-83d4-26f57c133b9f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.836520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827f6f-424a-4de7-83d4-26f57c133b9f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.836520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 399/790] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:34.842731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.843019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.843296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.860124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:34.862897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:34.864993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:34.927858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e2d27-fefc-4c94-a432-775d09263f4f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:34.957508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 400/791] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:34.957508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:34.987411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:34.988445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:34.988902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:34.989936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:34.990973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:34.991468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:34.993110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.006792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 392/792] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:35.012172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.055243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.074292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1721a4-0047-42f7-a3ff-625dfb59ccfe None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.111941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.112615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.112901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.113177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.113922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:35.114828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.116245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.124840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d236126-6f6c-43ce-beb5-d2471c0ed5ed None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.126305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 401/793] 10.222.0.61 () {56 vars in 1124 bytes} [Fri May 27 03:10:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:35.127614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.133837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.168237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.169359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.169818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.170614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.186121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:35.199256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:35.200247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:35.201098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:35.204239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 393/794] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:35.205275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.249393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8537b8c-2e1c-4759-99cc-8e2095a592f1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.287010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.287964 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.288352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.288720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.296760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.299255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:35.315967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:35.317777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:35.318844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:35.324438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 402/795] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:35.325602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.330260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74655e19-18ae-4550-b491-b6e636902d86 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.337898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.367816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.368815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.369273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.369718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.370654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.372324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.402398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 394/796] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:10:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:35.403829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.443717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c711e7-7e66-4f82-bc2a-6ff4b5938a4b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.455622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.491874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.492787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.493067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.493419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.497992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:35.497992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.497992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.506766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 403/797] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:35.512761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.587650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.629480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801145-7bff-497e-b31d-770fe03f0a08 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.639281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fb4c-c525-4295-8c3e-c9736be58618 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.681216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.682067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.682356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.682633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.704159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.705644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.711376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.712070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.712359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.712626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.713472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:35.713784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.715281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:35.735306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:35.736253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:35.737153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:35.737153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:35.737153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:35.737153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:35.737153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 404/798] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:35.740270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 395/799] 10.222.0.61 () {56 vars in 1135 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:35.745179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.746317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.855320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416230-32e0-4a6d-a1fb-a27ca37b8f6a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.856748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0a51a-2eaf-4891-affa-6684c2cac92a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:35.875406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.894278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.894948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.895292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.895571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.896304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:35.896613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.897140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:35.898025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.898509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:35.898981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:35.899568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:35.911536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:35.916199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 405/800] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:35.916325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:35.916420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:35.918541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:35.942553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:35.943693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:35.944637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:35.944637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:35.944637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:35.944637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:35.947150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 396/801] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:35.952916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.071346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e0bd2-2c0f-4ed6-8a17-441bc83fcad2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.087131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293814a-1ec5-4377-a91a-bdeef6f731c6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.106947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:36.114393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.115432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.115918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.116412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.117434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:36.117946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:36.119549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:36.132816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 397/802] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:36.138175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.187592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c5729-c433-47ba-8791-1031570facef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.188443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c5729-c433-47ba-8791-1031570facef None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.188726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c5729-c433-47ba-8791-1031570facef None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.189048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c5729-c433-47ba-8791-1031570facef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.211221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c5729-c433-47ba-8791-1031570facef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:36.212704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c5729-c433-47ba-8791-1031570facef None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-188c5729-c433-47ba-8791-1031570facef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:36.239163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:36.241006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:36.243402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:36.250422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 406/803] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:10:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:36.271850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c5729-c433-47ba-8791-1031570facef None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.289482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf7ea-e9d7-49e1-84a2-46d739e3dd2a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.359886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.362068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.362881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.363656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.372427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:36.374338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:36.377621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:36.403258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:36.404439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:36.405539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:36.414751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 398/804] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:36.422076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.520080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:36.532351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c5729-c433-47ba-8791-1031570facef None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.578273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.578981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.579264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.579544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.580414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:36.580726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:36.582280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc292-5152-4b3e-88d6-39c0435d6456 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:36.604428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 407/805] 10.222.0.61 () {56 vars in 1149 bytes} [Fri May 27 03:10:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:36.605888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd95ebf-88e0-4db7-80c7-de2c6090ef74 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.606210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd95ebf-88e0-4db7-80c7-de2c6090ef74 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.606486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd95ebf-88e0-4db7-80c7-de2c6090ef74 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.607835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 408/806] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:36.611171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7d5c-3292-41a7-8b3d-3599494376ac None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.620048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd95ebf-88e0-4db7-80c7-de2c6090ef74 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.669763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.670292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.670571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.670843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.671654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:36.671960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:36.673523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7138435-4e9f-4179-9cef-32958efe9f2d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:36.686893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 399/807] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:36.688551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb68b6-d23f-4aeb-b09b-4617bec7233d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.688841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb68b6-d23f-4aeb-b09b-4617bec7233d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.689170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb68b6-d23f-4aeb-b09b-4617bec7233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.750879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:36.761416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd95ebf-88e0-4db7-80c7-de2c6090ef74 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.800210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.802061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.802555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.803045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.814572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:36.816428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:36.832715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-84eb68b6-d23f-4aeb-b09b-4617bec7233d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:36.833949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-84eb68b6-d23f-4aeb-b09b-4617bec7233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:36.838433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:36.839329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:36.840222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:36.840222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:36.840222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:36.840222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:36.843002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 409/808] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:36.844744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.905821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 400/809] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:36.908312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf048b5-6deb-47da-8bee-c40452686654 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.909137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf048b5-6deb-47da-8bee-c40452686654 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.909904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf048b5-6deb-47da-8bee-c40452686654 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.912191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 401/810] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:36.913130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf048b5-6deb-47da-8bee-c40452686654 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:36.956621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e4f12-ee9e-4176-a4e2-c322278c1ba0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:36.965249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:36.994262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd0ed-4394-4efe-8621-e810b4c06466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:36.995321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd0ed-4394-4efe-8621-e810b4c06466 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:36.996364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd0ed-4394-4efe-8621-e810b4c06466 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:36.996648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd0ed-4394-4efe-8621-e810b4c06466 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/effdc345daee49d8ad4a09f2dd6fd40e/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:36.998645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd0ed-4394-4efe-8621-e810b4c06466 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=effdc345daee49d8ad4a09f2dd6fd40e, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.000086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd0ed-4394-4efe-8621-e810b4c06466 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.014700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 410/811] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:36 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/effdc345daee49d8ad4a09f2dd6fd40e/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:37.016262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.016637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.016982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.040035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf048b5-6deb-47da-8bee-c40452686654 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.041810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:37.043559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:37.047058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.086162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.087390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.087921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.088347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.089241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:37.089758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.091512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.106149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 402/812] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:37.107435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.154421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 411/813] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:37.155981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.253686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846981c8-f3c7-4874-a4e9-a6e01ceb2465 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.255699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.298961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.300194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.300497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.300775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.304326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629f852-0d03-42a5-b379-da7f64474430 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.315373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:37.325578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:37.326630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:37.327504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:37.330054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 403/814] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:37.331056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.347320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.348964 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.349398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.349815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.357356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.359050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.361425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:37.376732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:37.377891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:37.379000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:37.381119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 412/815] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:37.382296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.466073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44c2f8-a186-46a6-a517-7b55ca459ce5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.495592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd33ad-7559-497a-88b6-edcd8d1dda27 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.516536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.517591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.517881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.518178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] PATH_INFO: `/v3/services/network` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.518836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.521197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:37.536626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:37.537690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:10:37.538589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:37.541456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 404/816] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:37.542509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.542893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.543717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.544071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.544353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.545161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:37.545467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.547394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.562055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 413/817] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:37.563328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.578169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.644325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.672391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c6cd-d38f-43cb-9f5f-4109d97abc3d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.695258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7ae09-5037-4587-8c37-5fe7223b9a75 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.719882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.720473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.720760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.721042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.722108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:37.722629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.725491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.734824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.735492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.735772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.736043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.736859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] RBAC: Adding query filter params (name=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:37.737226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.738640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.743583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 405/818] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:37.744724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.749260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 414/819] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:37.749493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.864358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.878922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ceec1-70df-4934-b664-26467e4f1565 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.886145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689d320-fa0c-4972-a801-464670505ebf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:37.910698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:37.924758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.925753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.926199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.926630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/6af8f930d4e94212896840b336e6f9cf/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.934565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:37.935944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:37.937035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:37.937476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:37.944369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=6af8f930d4e94212896840b336e6f9cf, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.945953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.952392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:37.953996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:37.970819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 415/820] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:37 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/6af8f930d4e94212896840b336e6f9cf/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:10:37.970819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:37.986948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:37.988756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:37.989827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:37.989827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:37.989827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:37.989827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:37.995870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 406/821] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:37.999305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:38.165998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137640e2-971b-42ef-ac06-92d39600ab48 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:38.201809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:38.202554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.202794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.203071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.203791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:38.204100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:38.205502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:38.216746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 416/822] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:38.218151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:38.248424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd978f5-ffca-4d8e-adb3-e919fdc8fe35 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:38.273890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:38.298626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:38.300036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.300419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.300955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.302862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:38.303517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:38.305035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80375e95-9936-428a-802d-fc0262e977c4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:38.315017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:38.325410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 407/823] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:38.328421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656cca-4fbb-4ad2-87de-3e265b70e352 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.329099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656cca-4fbb-4ad2-87de-3e265b70e352 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.329536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656cca-4fbb-4ad2-87de-3e265b70e352 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.331345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 408/824] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:38.336277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656cca-4fbb-4ad2-87de-3e265b70e352 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:38.361753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc93a3-75ca-4611-a7d9-9dcd35b329d6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:38.406418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bf031-8976-4eeb-b8e9-0892f0cfe9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:38.407392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bf031-8976-4eeb-b8e9-0892f0cfe9c8 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.407841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bf031-8976-4eeb-b8e9-0892f0cfe9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.408364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bf031-8976-4eeb-b8e9-0892f0cfe9c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.409272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bf031-8976-4eeb-b8e9-0892f0cfe9c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:38.411417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bf031-8976-4eeb-b8e9-0892f0cfe9c8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:38.445367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 417/825] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:10:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:38.455058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.455058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.455058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.487328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:38.491644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:38.566437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656cca-4fbb-4ad2-87de-3e265b70e352 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:38.638111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 418/826] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:38.679907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:38.681751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.682528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.683261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.704842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:38.711211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:38.711835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:38.737037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:38.738953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:38.740792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 409/827] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:10:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:38.746245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:38.763817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:38.837594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:38.877638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43062c5-cf8b-4fcc-9083-8cd716ce6c50 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:38.905559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f7fc3-a177-4d43-b22d-47610fdbc8ed None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:38.933303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:38.934176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.934760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.935039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.936227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:38.937700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:38.956905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:38.958181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:38.959085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 419/828] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:38.965991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:38.965991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:38.965991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:38.965991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:38.967180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:38.967180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:38.967367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:38.967460 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:38.996196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 410/829] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:10:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:39.003060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.081500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.095355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0b18-1f4a-4c85-816b-1a1eace22097 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.121259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6cbb-1658-4943-b025-6dc9a6856406 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.135387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.140220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.141162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.141654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.142174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.143084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:39.143992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.146652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.157684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 420/830] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:39.158835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.164746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac113-caa6-4dd4-a211-8d88fab2689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.165409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac113-caa6-4dd4-a211-8d88fab2689e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.165686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac113-caa6-4dd4-a211-8d88fab2689e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.165952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac113-caa6-4dd4-a211-8d88fab2689e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.238994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac113-caa6-4dd4-a211-8d88fab2689e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.240512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac113-caa6-4dd4-a211-8d88fab2689e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.262787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c2d17-9ec5-4d85-b51d-f53a0abb9c41 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.303502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.304571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.305066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.305535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.306513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:39.307053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.308688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.318355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 421/831] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:39.357497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 411/832] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:10:39.363108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.382397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.475611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d87d67-0b69-4eab-b6b0-75df729f3094 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.478251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca5e11-083c-4d7d-a70e-4ffca0355cfb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.478533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca5e11-083c-4d7d-a70e-4ffca0355cfb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.478809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca5e11-083c-4d7d-a70e-4ffca0355cfb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.481778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 412/833] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:39.486391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.486677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.486957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.509349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:39.513168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:39.524722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.530693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.531626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.531833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.532073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.543870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.545326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:39.566219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:39.567215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:39.568289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:39.568289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:39.568289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:39.568289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:39.568289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 422/834] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:39.573598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.610156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 413/835] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:39.627965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.650749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.689589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91bb8a-cc27-459f-8292-c10ac31e3306 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.727210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.727891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.728172 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.728445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.729166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:39.729468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.731086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.734485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d04079-6159-44dc-a1a2-7886b730d7d9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.749438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 423/836] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:39.750521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.772930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.774160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.774649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.775126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.786823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:39.794961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:39.795967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:10:39.796843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:39.804277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 414/837] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:39.805806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.810688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.861470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc259c-42a7-45f4-8c64-d3aa839d0fc4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.894357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:39.899254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.900230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.900515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.900848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.908577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.910301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.916725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a024-0d77-4301-832e-930dcc1b279e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:39.926870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:39.927829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:39.929152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 424/838] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:39.933893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:39.957264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:39.958423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:39.958913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:39.959398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:39.960362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:39.960887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:39.962522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:39.976490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 415/839] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:39.978529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.045924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:40.052901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233082c-e494-4e03-a063-5b2cc928ae2c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.090693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca0c8-34a0-4a80-b5e4-833dab04d3bd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.093193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.094738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.094738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.094919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.095694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:40.096009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:40.097474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:40.111555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 425/840] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:40.117417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.128930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.130704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.131193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.131682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.143156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:40.144976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:40.164012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:40.164964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:40.165869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:40.165869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:40.165869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:40.165869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:40.172593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 416/841] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:40.173793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:40.174419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.232599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca1c9-6d21-473c-b4dc-f974094e9953 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.268944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.269588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.269865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.271049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.271871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=9799f9d11546403e8b46ad386be470d8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:40.272178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:40.274051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:40.283018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4d9e3-4b7f-4627-8eef-c215184c9383 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.286631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 426/842] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/role_assignments?user.id=9799f9d11546403e8b46ad386be470d8&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:40.303362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:40.326898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.328013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.328547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.329042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.330077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:40.330637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:40.332321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63311-b239-4ed8-8945-6b50fef358d9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:40.352039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 417/843] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:40.353800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.472395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d47dc1-9de6-4801-a8c3-8e1f7aa71238 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.488627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:40.512918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72d56-a30c-4615-bdfe-94fa4e12c6c9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.513261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72d56-a30c-4615-bdfe-94fa4e12c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.513475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72d56-a30c-4615-bdfe-94fa4e12c6c9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.513587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.515130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.515130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.515130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.515381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 418/844] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:40.521019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.521300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.521574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.531259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:40.532724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:40.541678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:40.542937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:40.553642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:40.554683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:40.555829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 427/845] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:40.564213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.632738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 419/846] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:40.656794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.696985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1923-3607-4e43-8ddc-6de5e5933829 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.743257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.744568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.745934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.746463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.747522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:40.748038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:40.750225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:40.778290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 428/847] 10.222.0.61 () {56 vars in 1135 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:40.780272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.789112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec51d5-aac8-4d11-a96e-01970ce44a11 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.797578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:40.825398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:40.829425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.830434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.830832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.831605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:40.848568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:40.858923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:40.860142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:10:40.861189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:40.869458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 420/848] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:40.871063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:40.912523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f59b6-4d20-4c5c-8823-716950655fe6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:40.950733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:40.951403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:40.951857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:40.952188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.002151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61bd9a-f9ec-4a82-a723-33b090051674 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.038967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.039712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.040001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.040276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.041151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:41.041462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.043047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.047139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.049639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.058091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 421/849] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:41.060871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.089534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.102203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.182187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 429/850] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:10:41.184541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.212707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21778bdd-fa25-46c1-850c-416e74b5cef1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.262474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.264234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.264852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.265427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.281890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.284464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.303990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9b64-b6ac-400b-b27a-031dcb5ead79 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:41.308029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:41.308974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:41.309903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:41.309903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:41.309903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:41.309903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:41.314037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 422/851] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:41.315037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.349316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.358445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.359514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.359949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.360383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.375383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.377712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:41.402720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:41.403891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:41.405048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:41.405048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:41.405048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:41.405048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:41.407896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 430/852] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:41.413019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.413955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.442531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51143f-c3b3-4faa-80cd-3be663547363 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.497654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.498898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.499731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.500639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.501860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:41.502405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.505376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.525533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 423/853] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:41.531000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.557183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea5cca-f920-40b1-b09e-ff44f055aeea None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.599698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.600587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.600963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.601385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.602386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:41.602756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.604327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6151a-b1c1-4dbc-9a23-67e6113eb5f3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.617741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 431/854] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:41.619868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e5e14-5723-44c6-94a0-33afecfbc865 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.620311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e5e14-5723-44c6-94a0-33afecfbc865 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.620742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e5e14-5723-44c6-94a0-33afecfbc865 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.622645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 432/855] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:41.623950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e5e14-5723-44c6-94a0-33afecfbc865 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.648493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1ae96-5dff-49cd-832d-3e3d519b790d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.675402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.689684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.690547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.690827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.691099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.699622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.701070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.704828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3657cae2-7dea-429f-b0a6-4a714b3d422c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:41.720730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:41.721746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:41.722730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:41.726861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 424/856] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:41.728061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.728359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.728631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.737822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e5e14-5723-44c6-94a0-33afecfbc865 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.746202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:41.747501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:41.777291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.778055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.778338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.778620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.786573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.788034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:41.803302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:41.804278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:41.805213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 433/857] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:41.805716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.834017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 425/858] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:41.834017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.919969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d4d95-0d01-405f-b646-53d6a3c78d49 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.921661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.943570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4ad51-7e79-4a22-8af9-b09ba71bd360 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:41.957894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.958651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.958937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.959213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.960211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:41.960525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.962100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.973481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:41.980418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:41.981086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:41.986157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:41.986321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 434/859] 10.222.0.61 () {56 vars in 1149 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:41.986422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:41.986531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:41.986608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:41.986608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:41.986608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:41.999019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 426/860] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:41.999019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:42.097383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396708c-e7ed-4778-a578-1b646eb14009 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:42.120727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033565b-f025-4fa5-9d47-18d0100fb728 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:42.136985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:42.137668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.137950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.138250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.138980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:42.140368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:42.166421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 435/861] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:10:41 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:42.167449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:42.170876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:42.171655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.171942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.172217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.202205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:42.257663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:42.279710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:42.281265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:42.311242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c665d8-0314-4a59-bba0-e0b93e72f440 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:42.353255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:42.355050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.355050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.355050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.355527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=effdc345daee49d8ad4a09f2dd6fd40e) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:42.355797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:42.357266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:42.365628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 436/862] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:42 2022] GET /identity/v3/role_assignments?user.id=effdc345daee49d8ad4a09f2dd6fd40e&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:42.420587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 427/863] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:41 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:10:42.425933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:42.531271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:42.557025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba044-d1f3-40f7-8c36-f233e52c90a8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:42.593778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:42.594620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.594902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.595174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.610785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:42.612569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:42.633402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:42.634450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:42.635612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:42.635612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:42.635612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:42.635612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:42.635612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 437/864] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:42.640617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:42.735603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:42.751370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd6b4-493a-4980-b45d-81c7ef6a728f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:42.788225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:42.788907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.789192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.789468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.790208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:42.790517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:42.791906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181cc6d-93b1-44d5-b0ee-dd4655d0b9b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:42.804858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 428/865] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:42.810408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:42.815458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426a25e-5bac-40ba-8e76-0b9079078f91 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.815624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426a25e-5bac-40ba-8e76-0b9079078f91 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.815897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426a25e-5bac-40ba-8e76-0b9079078f91 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.818137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 429/866] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:42.823603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.824478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.824955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.849185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:42.851040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:42.930265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47391436-45eb-46cd-8b23-a923ccec4beb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:42.945649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 430/867] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:42.968433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:42.970520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:42.971558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:42.972069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:42.972341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:42.975333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:42.980629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:42.982287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:42.997738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:42.998897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:43.000020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 438/868] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:43.005505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:43.069850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:43.101024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2408f-55b1-4857-b81a-8d2ca135fe62 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:43.131283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12af8-510d-4426-b0f6-f7a70eb53703 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:43.150697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:43.151604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:43.151955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:43.152297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:43.153028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:43.154992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:43.169327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:43.170425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:43.170897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:43.171229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:43.172382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:43.173467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:43.178314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 431/869] 10.222.0.61 () {56 vars in 1132 bytes} [Fri May 27 03:10:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:43.178529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:43.178529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:43.178529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:43.181252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:43.182130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:43.195184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 439/870] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:43.201986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:43.280946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:43.308481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa3d9-3c25-4fe6-b57b-338e32b3e93c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:43.343250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ef6f9-a69e-462c-b76f-6f674d07c860 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:43.346548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:43.347443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:43.347924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:43.348885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:43.349786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:43.350271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:43.351871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:43.362081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 432/871] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:43.363322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:43.368987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:43.389764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:43.391148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:43.391536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:43.391920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:43.393149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=6af8f930d4e94212896840b336e6f9cf) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:43.393574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:43.396119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122e54c-1e42-428c-91aa-a29382b97363 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:43.406123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 440/872] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:43 2022] GET /identity/v3/role_assignments?user.id=6af8f930d4e94212896840b336e6f9cf&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:43.489668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ebbc0-2c49-40e5-9755-8730237e8e60 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:43.530561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:43.531509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:43.531969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:43.532407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:43.533284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:43.533749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:43.535397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0483d8-e172-48f3-aa2f-3a7240473a7c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:43.541300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 433/873] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:44.692416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906786-6d08-46ca-be3f-0824e0ae02ca None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:44.692946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906786-6d08-46ca-be3f-0824e0ae02ca None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:44.692946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906786-6d08-46ca-be3f-0824e0ae02ca None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:44.694715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 441/874] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:44.696938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6b32-3a92-41f2-ad8f-808fef5dba68 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:44.697430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6b32-3a92-41f2-ad8f-808fef5dba68 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:44.697508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6b32-3a92-41f2-ad8f-808fef5dba68 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:44.699233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 434/875] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:44.705086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:44.705541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:44.706014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:44.706422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:44.706672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:44.706942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:44.726292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:44.727498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:44.729902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:44.731133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:44.802751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:44.809730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 435/876] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:44.830098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 442/877] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:44.831633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:44.850963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:44.912404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:44.943602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77602a-51d5-4080-aac4-aec36fc00b77 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:44.965768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4560d-864d-46e9-8d79-95c8f0def519 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:44.979901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:44.980923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:44.981336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:44.981751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:44.982578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:44.984213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:44.996827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:44.997857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:44.998742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:45.005680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 436/878] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:45.007490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:45.009325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.010190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.010470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.010743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.011394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.012777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:45.026325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:45.027385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:45.028256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:45.032708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 443/879] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:45.034033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:45.077818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:45.119626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ac821-a17c-490a-b90f-6c60b460765b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:45.141332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7017e-3e1a-4746-a74a-ea9affe4f76c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:45.156890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.157849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.158331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.158438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:45.158946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.159872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:45.160899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.162545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.172459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 437/880] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:45.173690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:45.180826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.181595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.181943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.182318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.183092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:45.183462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.185346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.191654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 444/881] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:45.196740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:45.282003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119b6fc-d893-4d4b-8b27-d9da8d563118 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:45.304187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f56c7f-6097-48aa-b295-e5e504db114e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:45.309510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:45.323789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.324478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.324765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.325048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.325761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:45.326125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.328521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.337660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 438/882] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:45.343068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:45.349824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.350543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.350830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.351109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.351822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:45.352131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.353535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.360135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 445/883] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:45.474413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5a62-64f6-441a-8f2b-0c0ed8839a51 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:45.512726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.512726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.513142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.513319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.514114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] RBAC: Adding query filter params (interface=public, service_id=e8cbd60bc0884eba83149ebe61a55946, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:45.514423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.515792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb539a-56f2-4fbf-9881-8aa3c6102129 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.522039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 439/884] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:10:45 2022] GET /identity/v3/endpoints?service_id=e8cbd60bc0884eba83149ebe61a55946&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:45.531144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:45.579890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:45.643072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34504f8c-568d-45f6-8f09-54f69f13ecab None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:45.687760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62790297-92d3-4c57-862a-0712c4b608da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:45.688769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62790297-92d3-4c57-862a-0712c4b608da None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.689202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62790297-92d3-4c57-862a-0712c4b608da None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.689651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62790297-92d3-4c57-862a-0712c4b608da None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.690546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62790297-92d3-4c57-862a-0712c4b608da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:45.692143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62790297-92d3-4c57-862a-0712c4b608da None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:45.698689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 446/885] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:10:45 2022] GET /identity/v3/services => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:10:45.845287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520fe9-1b0f-4e91-b188-e9ca0a1da56c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.845825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520fe9-1b0f-4e91-b188-e9ca0a1da56c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.845825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77520fe9-1b0f-4e91-b188-e9ca0a1da56c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.847675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 440/886] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:45.854086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.854379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.854661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.861139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c74c-22c4-43cf-aa6c-e463dec4b9ad None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.861463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c74c-22c4-43cf-aa6c-e463dec4b9ad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.861703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295c74c-22c4-43cf-aa6c-e463dec4b9ad None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.863464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 441/887] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:45.869134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:45.869467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:45.869692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:45.874139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:45.875677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:45.887589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:45.888844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:45.956128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:45.969936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 447/888] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:45.982168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 442/889] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:45.994804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:46.011992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:46.041401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:46.139157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631b6e-7f8d-4b51-ab64-7f0c4f30f007 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:46.159939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd8d99-610f-49e3-9464-9301f6809831 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:46.177500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:46.178202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:46.178493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:46.178780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:46.179698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:46.181150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:46.201424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 448/890] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:10:45 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:46.225434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:46.226833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:46.227345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:46.227835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:46.241789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:46.251699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:46.252779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:10:46.253694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:46.257883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 443/891] 10.222.0.61 () {56 vars in 1120 bytes} [Fri May 27 03:10:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:46.264598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:46.377120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:46.386877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc763d-9373-4e45-b65d-cfc549f90d81 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:46.423631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:46.424230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:46.424520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:46.424789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:46.425532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:46.425891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:46.427589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:46.441171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 449/892] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:10:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:46.447692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:46.498575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:46.561378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8b3e-c177-4944-a290-e04702a81046 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:46.600216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:46.601194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:46.601572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:46.601944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:46.614519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:46.615973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:46.634450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:46.635419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:46.636367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:46.636367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:46.636367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:46.636367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:46.636367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 444/893] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:46.642898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:46.746738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bf6c8-8010-45c6-9220-cb31af668d3f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:46.781077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:46.781749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:46.782056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:46.782331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:46.783048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:46.783354 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:46.784766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:46.797806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 450/894] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:46.803862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:46.899189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:46.907863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5559e-2246-4f16-9abf-b3e9567e6adb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:46.945712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:46.946576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:46.946858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:46.947131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:46.956249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:46.957799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:46.975332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:46.976387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:46.977352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 445/895] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:10:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:46.987080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:47.008091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:47.096527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b0bca-0979-429b-8d39-c74d812c26e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:47.133884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:47.134595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:47.134877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:47.135156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:47.135993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:47.136298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:47.137748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:47.156760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 451/896] 10.222.0.61 () {56 vars in 1149 bytes} [Fri May 27 03:10:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:47.162385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:47.283414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4facc-443f-48d2-b9a4-95dee1e15109 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:47.318610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:47.319272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:47.319898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:47.320177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:47.342354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:47.392550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:47.394057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:47.505257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 446/897] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:47 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:10:47.511611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:47.615543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:47.639922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4df84-5943-4695-b347-3a46e7918a22 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:47.677495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:47.678684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:47.679218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:47.679698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:47.690714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:47.693198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-723d0384-1426-4939-8b70-633994b7a874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:47.712223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:47.713249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:47.714225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:47.714225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:47.714225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:47.714225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:47.716478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 452/898] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:47.722568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:47.770934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca17f1c-ab08-4975-a6dd-c5f9a32626e6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:47.771916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca17f1c-ab08-4975-a6dd-c5f9a32626e6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:47.772399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca17f1c-ab08-4975-a6dd-c5f9a32626e6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:47.774280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 453/899] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:47.779103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:47.779524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:47.779719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:47.783325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:47.799273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:47.800829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:47.831912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60928940-b406-4363-a153-7fae73cde5b4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:47.875560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:47.876304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:47.876683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:47.877110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:47.877949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:47.878414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:47.880489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:47.880861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 454/900] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:47.894654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 447/901] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:47.900686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:47.906385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:47.980344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.025122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf03d5-591a-42a3-a16f-bf4c3249b5a7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.038719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69fd32-cabe-4cad-b92a-d2ee0140cedc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.053824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.069273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.070655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.071179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.071703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.080530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.082995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.083278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.084107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.084401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.084664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.085576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.087315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7308884c-6eef-487d-abf0-0b20164a65ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:48.103268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:48.104330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:48.105284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:48.107186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 448/902] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:10:47 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:48.108272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 455/903] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:48.116857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.140135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09579f1-a958-4dd7-a9ec-4286e61854ed None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.140315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09579f1-a958-4dd7-a9ec-4286e61854ed None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.140603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09579f1-a958-4dd7-a9ec-4286e61854ed None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.147072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 456/904] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:48.148558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.148849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.149132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.168620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:48.169867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:48.257026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 457/905] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:48.257649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8c49-79cc-414e-b72d-17b83baea8f6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.281714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.307788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.308650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.308931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.309205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.310379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:48.310689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.312439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.330088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 449/906] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:48.335509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.338431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.373293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.410783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52ccec-8dd6-4e0a-a4c5-36a55e8a57a8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.460895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.462151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.462649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.462864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567865f9-cac4-48c5-be6e-f25467d7ab03 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.463356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.464323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.466904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:48.486446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:48.487597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:10:48.488490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:48.492209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 458/907] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:48.499915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.522119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.522958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.523384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.523659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.524488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] RBAC: Adding query filter params (role.id=69dca09a8aa64afa98e0c6acf659db66, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=6af8f930d4e94212896840b336e6f9cf) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:48.524797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.527147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3b10-aa69-44d1-89ad-66aa4d96ee1b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.542162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 450/908] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/role_assignments?user.id=6af8f930d4e94212896840b336e6f9cf&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=69dca09a8aa64afa98e0c6acf659db66 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:48.633012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d495a5-b328-43c1-83e5-110d067f088c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.644030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.669749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01308-5fb9-4770-b1db-f5f335a74a30 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.670402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01308-5fb9-4770-b1db-f5f335a74a30 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.670887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01308-5fb9-4770-b1db-f5f335a74a30 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.672548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 451/909] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:48.678123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.678837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.679124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.679405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.679887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.680373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.680851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.681908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:48.682390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.684075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.689881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 459/910] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:48.696653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.699206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:48.700528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:48.795464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 452/911] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:48.818448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.820786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a06e-20ba-41e7-9f25-e4f92f5e3f55 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.844435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.874583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.875577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.876613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.877049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.878249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:48.879533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.881894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.894010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 460/912] 10.222.0.61 () {56 vars in 1114 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:48.895970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:48.932030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f08b04-7494-4a84-a0a7-8e77c6d5bf58 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:48.946715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:48.969589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:48.970435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:48.970719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:48.970993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:48.971643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:48.973066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:48.986215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:48.987260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:48.988137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:48.993012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 453/913] 10.222.0.61 () {56 vars in 1132 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:48.993936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:49.044328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcce41e-c001-4aa7-ad39-c99c338a954e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:49.086830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:49.098984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:49.100348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:49.101253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:49.102021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:49.102985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:49.103598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb3d78-01ea-4226-811d-6c1c7fe7b382 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:49.104878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:49.139749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 461/914] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:10:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:49.157033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:49.157747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:49.158137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:49.158361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:49.159124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:49.159473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:49.161651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:49.168585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 454/915] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:49.174715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:49.282350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:49.295373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b46dd-c750-46fa-b22e-6558b153a669 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:49.339509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:49.340611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:49.341252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:49.341752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:49.342733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:49.343267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:49.345214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:49.352725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 462/916] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:49.358554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:49.479100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351b720-f431-468e-86e8-8771fcfa8c5d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:49.516334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:49.517160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:49.517543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:49.517923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:49.518858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] RBAC: Adding query filter params (interface=public, service_id=2881f3bd47fe4614a4e79d9986bc2fbd, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:49.519278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:49.521282 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d69c-51a4-4afa-ae86-778cf543b590 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:49.527353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 455/917] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:10:49 2022] GET /identity/v3/endpoints?service_id=2881f3bd47fe4614a4e79d9986bc2fbd&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:49.532597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:49.635698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716130a0-9579-4566-a717-2710018d7e0a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:49.675445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cdc5d-9f40-4178-8a45-e11847327442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:49.676211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cdc5d-9f40-4178-8a45-e11847327442 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:49.676499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cdc5d-9f40-4178-8a45-e11847327442 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:49.676778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cdc5d-9f40-4178-8a45-e11847327442 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:49.677510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cdc5d-9f40-4178-8a45-e11847327442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:49.678932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cdc5d-9f40-4178-8a45-e11847327442 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:49.688559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 463/918] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:10:49 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:10:50.564507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8bd38-83c1-4687-bc6f-1ae0e075555b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:50.565527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8bd38-83c1-4687-bc6f-1ae0e075555b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:50.566039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8bd38-83c1-4687-bc6f-1ae0e075555b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:50.568468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 456/919] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:50.574546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98f2d3-c741-4657-b00e-6f88aecfc48a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:50.575681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98f2d3-c741-4657-b00e-6f88aecfc48a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:50.576168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98f2d3-c741-4657-b00e-6f88aecfc48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:50.594717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bd98f2d3-c741-4657-b00e-6f88aecfc48a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:50.596594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bd98f2d3-c741-4657-b00e-6f88aecfc48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:50.614079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:50.694106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 464/920] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:50.716045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8bd38-83c1-4687-bc6f-1ae0e075555b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:50.734720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:50.839455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8bd38-83c1-4687-bc6f-1ae0e075555b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:50.881787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:50.883184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:50.883758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:50.884298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:50.885382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:50.887292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:50.893166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bacfc-f729-4504-8c62-935294875431 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:50.893452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bacfc-f729-4504-8c62-935294875431 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:50.893733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bacfc-f729-4504-8c62-935294875431 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:50.895504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 465/921] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:50.900815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:50.901102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:50.901383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:50.904611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:50.905798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:50.906690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:50.909253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 457/922] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:50.916287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:50.922216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:50.923412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:51.018054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 466/923] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:51.029853 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.041507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.065368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076725a-ee9b-4111-b355-4029b049409d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.108776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.109393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.109711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.109950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.110977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:51.111292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.112722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.122420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 458/924] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:51.126364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.179895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c6a2-bffd-494a-a9db-4095bf87dfc1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.186335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.229725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.231340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.231957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.232538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.249205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:51.254831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e811-ada8-4564-9748-96469d6d0d3f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:51.268719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:51.270311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:10:51.271166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:51.279011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 467/925] 10.222.0.61 () {56 vars in 1120 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:51.280464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.292844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.293520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.293804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.296478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.296478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:51.296478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.297072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.307871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 459/926] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:51.309230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.312128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.412773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4141074-d40d-477b-ab75-78fcf263f597 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.424073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4b484-7a6e-4cb4-8079-33aa7cb1ebba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.460152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.461852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.462722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.462889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.463603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.463717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.463976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.464319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.465216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] RBAC: Adding query filter params (interface=public, service_id=e46d9f0c4fb642aea42ece5411d821c2, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:51.465605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.466079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:51.466747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.467309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.470168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.479346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 460/927] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/endpoints?service_id=e46d9f0c4fb642aea42ece5411d821c2&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:51.480883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.492658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 468/928] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:51.494938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.498214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.564656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.603206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0067c2-d4ba-4f35-abac-53b3d40b23b0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.622212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6e5e5-0c7a-47b5-bd97-00de2876991d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.640174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0559b-8085-4faa-8f99-ff2385b519c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.640955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0559b-8085-4faa-8f99-ff2385b519c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.641310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0559b-8085-4faa-8f99-ff2385b519c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.641659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0559b-8085-4faa-8f99-ff2385b519c6 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.642599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0559b-8085-4faa-8f99-ff2385b519c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.643987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0559b-8085-4faa-8f99-ff2385b519c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.656336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 461/929] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:10:51.659680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cfeb7-e865-48b6-bad3-6fd3b3327af9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.660726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cfeb7-e865-48b6-bad3-6fd3b3327af9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.661339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cfeb7-e865-48b6-bad3-6fd3b3327af9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.663584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 462/930] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:51.670410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.670970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.671416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.674615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.676220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.676643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.677005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.690781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.692772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.698758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:51.700296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:51.713800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:51.714903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:51.715886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:51.715886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:51.715886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:51.715886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:51.715886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 469/931] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:51.723644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.799461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.810180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 463/932] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:51.834556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.870421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6559-d682-4271-a677-eb7d49250cb5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:51.916660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:51.922638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:51.923714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:51.924211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:51.924748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:51.926097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:51.926423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:51.927830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:51.942675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 470/933] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:51.951020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:51.976377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ddc5b-ab65-460c-977e-090c0a22506e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.024977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.026176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.026864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.027470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.028674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.030714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.034049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING keystone.server.flask.common [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 03:10:52.058758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 03:10:52.058758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 03:10:52.058758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [parameters: {'id': 'a2d115f8882c47849747345b0d418d94', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 03:10:52.058758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2d115f8882c47849747345b0d418d94.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2d115f8882c47849747345b0d418d94. May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:10:52.069287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 03:10:52.070352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 27 03:10:52.071376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 03:10:52.072458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 03:10:52.074923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:10:52.077105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'id': 'a2d115f8882c47849747345b0d418d94', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.079488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:52.081591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2d115f8882c47849747345b0d418d94. May 27 03:10:52.091342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.094013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 464/934] 10.222.0.61 () {60 vars in 1140 bytes} [Fri May 27 03:10:51 2022] POST /identity/v3/projects => generated 262 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:52.095020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.097281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e835cd-d4de-4bc2-a003-5e76a847e488 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.116701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:52.144280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.145330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.145752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.146121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.154724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.156327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:52.175336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:52.176977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:52.178127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 471/935] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:10:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:52.183699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.245300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b5d6-82e6-47c5-94a3-5955164fdcab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.265850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:52.296963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.298090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.298375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.298649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.307428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.309098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.323320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c3c66-9784-4868-8bf2-382f6d83405a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-16b3eb54-3442-450b-a9de-aa9408a5b4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:52.326181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:52.327046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:52.327942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.333336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 465/936] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:52.334843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026aa75-47e6-4dc1-84ff-f2d9af00a7f5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.335128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026aa75-47e6-4dc1-84ff-f2d9af00a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.335414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026aa75-47e6-4dc1-84ff-f2d9af00a7f5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.339912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 466/937] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:52.340726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026aa75-47e6-4dc1-84ff-f2d9af00a7f5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.371866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.372544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.372820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.373136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.374089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:52.374399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.375922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca59793-7b32-422e-a34a-59c968bcc02b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.401180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 472/938] 10.222.0.61 () {56 vars in 1149 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:52.401180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.401180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.401180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.417742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:52.419102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:52.455970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:52.480102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026aa75-47e6-4dc1-84ff-f2d9af00a7f5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.518449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 473/939] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:52.519641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.537324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.538500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.539205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.539765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.541089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:52.541617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.543909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.567838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 467/940] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:52.570931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.633165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:52.674682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9ddee-bc8c-4cba-8073-9948d7ae5d6a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.721003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.721243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.721535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.721818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.738567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646510e-6936-414b-994e-bb66362018a8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.740594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.743425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:52.763768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:52.765020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:52.765975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:52.765975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:52.765975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:52.765975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:52.770911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 474/941] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:52.772333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.791267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:52.794428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.796628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.797478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.797755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.798693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.801047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:52.821993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:52.823017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:10:52.823892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:52.830129 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 468/942] 10.222.0.61 () {56 vars in 1132 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:52.831153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:52.914706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403274b-be01-4c1e-b143-047f042a32e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.957488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc41e1-f291-41af-bebc-52301b598085 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:52.960092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:52.960728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:52.960842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:52.961043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:52.961317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:52.962119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:52.962430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:52.963898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:52.982729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 475/943] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:52.984634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:53.007980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:53.008657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:53.008984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:53.009262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:53.010295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:53.010605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:53.012616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:53.020877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 469/944] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:53.026971 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:53.094539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:53.126274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f9ef-2625-4ea0-b147-2367be70b637 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:53.164201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e200d-e4c8-4b01-9ba8-839dc3ad744b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:53.167597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:53.168511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:53.168861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:53.169262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:53.177873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:53.179467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:53.199957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:53.200965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:53.201907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:53.206150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 476/945] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:53.208969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:53.212835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:53.215197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:53.215197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:53.215197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:53.215457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:53.215694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:53.217122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:53.228401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 470/946] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:53.229884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:53.274622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:53.353615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd16a6a-4fef-46b5-905d-d966ce1eb5af None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:53.376659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6921-b19a-4d27-a776-0abc03a7d0a5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:53.396125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:53.396812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:53.397091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:53.397358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:53.398731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:53.399050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:53.401218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:53.403649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:53.419631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 477/947] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:53.427186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:53.432018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cd304-d30f-499d-b89d-59dc907673c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:53.432789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cd304-d30f-499d-b89d-59dc907673c3 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:53.433160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cd304-d30f-499d-b89d-59dc907673c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:53.433564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cd304-d30f-499d-b89d-59dc907673c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:53.434441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cd304-d30f-499d-b89d-59dc907673c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:53.435993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cd304-d30f-499d-b89d-59dc907673c3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:53.466502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 471/948] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:10:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:10:53.609790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b02a6-2713-40e0-ac2f-5c31e999dd73 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:53.662659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943659f7-e66b-4e13-91fd-30b1c982fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:53.663615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943659f7-e66b-4e13-91fd-30b1c982fc02 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:53.663892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943659f7-e66b-4e13-91fd-30b1c982fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:53.664162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943659f7-e66b-4e13-91fd-30b1c982fc02 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/6af8f930d4e94212896840b336e6f9cf/roles/69dca09a8aa64afa98e0c6acf659db66` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:53.666515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943659f7-e66b-4e13-91fd-30b1c982fc02 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=6af8f930d4e94212896840b336e6f9cf, role_id=69dca09a8aa64afa98e0c6acf659db66)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:53.668017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943659f7-e66b-4e13-91fd-30b1c982fc02 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:53.685773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 478/949] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:10:53 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/6af8f930d4e94212896840b336e6f9cf/roles/69dca09a8aa64afa98e0c6acf659db66 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:10:54.108150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1dddc-dbff-47a8-972d-f4796f6a75d2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:54.108683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1dddc-dbff-47a8-972d-f4796f6a75d2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:54.108683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1dddc-dbff-47a8-972d-f4796f6a75d2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:54.110424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 472/950] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:54.116367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:54.116661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:54.116937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:54.134405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:54.135615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:54.193737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:54.221798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 479/951] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:54.244917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1dddc-dbff-47a8-972d-f4796f6a75d2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:54.345572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:54.367812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1dddc-dbff-47a8-972d-f4796f6a75d2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:54.405874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:54.406772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:54.407052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:54.407325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:54.407981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:54.409381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:54.423128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:54.424472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:54.425471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 473/952] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:54.431400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:54.544911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897152d-aaf2-4c38-bc1d-47e4e0837bbf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:54.583117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:54.583802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:54.584079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:54.584349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:54.585068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:54.585374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:54.586818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:54.592627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 480/953] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:54.599091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:54.706326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca076fc-6757-42fa-87b3-72c26c3d0535 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:54.746351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:54.747016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:54.747311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:54.747564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:54.748258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:54.748557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:54.749917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c314-9e76-478f-9baa-efb160720f73 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:54.755362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 474/954] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:54.763038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:54.814081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:54.878587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a00b3-1ba6-4230-88f5-e58bf5dd9949 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:54.917196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6e963-dc0b-42e6-b9fa-be5514855702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:54.917899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6e963-dc0b-42e6-b9fa-be5514855702 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:54.918208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6e963-dc0b-42e6-b9fa-be5514855702 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:54.918482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6e963-dc0b-42e6-b9fa-be5514855702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:54.919227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6e963-dc0b-42e6-b9fa-be5514855702 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:54.920696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6e963-dc0b-42e6-b9fa-be5514855702 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:54.942918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 481/955] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:10:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:10:55.075614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92acec7-d184-47d2-9774-90ddb8a74376 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.075817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92acec7-d184-47d2-9774-90ddb8a74376 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.076080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92acec7-d184-47d2-9774-90ddb8a74376 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:55.077652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 475/956] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:55.083848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.084519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.085067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:55.104154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:55.105708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:55.184566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 482/957] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:55.209994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92acec7-d184-47d2-9774-90ddb8a74376 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:55.226726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:55.319489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92acec7-d184-47d2-9774-90ddb8a74376 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:55.355720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:55.356307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.356585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.356855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:55.357551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:55.359012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:55.373292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 03:10:55.373292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 03:10:55.373292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [parameters: {'user_id': '3461f904d8124fef8620fc5ad12e0acc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 03:10:55.373292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 27 03:10:55.381328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:10:55.382327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 03:10:55.383840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 03:10:55.384962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:10:55.385890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:10:55.386790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'user_id': '3461f904d8124fef8620fc5ad12e0acc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:55.387657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 03:10:55.390919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:55.391869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 476/958] 10.222.0.61 () {60 vars in 1131 bytes} [Fri May 27 03:10:55 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:55.394669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:55.428428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:55.513888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402809-9e72-48b9-b0e4-a4d2f473e298 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:55.554617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:55.555426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.555708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.555984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:55.563934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:55.565409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c899578d-5099-4400-bd9a-3394b024f14e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:55.580728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:55.582306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:55.583283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 483/959] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:10:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:55.588541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:55.670006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:55.699291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dbd04-40cf-4064-b5b5-2e10416da4b1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:55.735889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:55.736950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.737451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.737992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:55.738993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:55.739494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:55.741403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9fb4b-4c69-45d1-8baf-2df739a840d4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:55.787481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 477/960] 10.222.0.61 () {56 vars in 1101 bytes} [Fri May 27 03:10:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:55.975522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6ee3-e0f8-440d-9fd6-5c3f190a5f84 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.976079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6ee3-e0f8-440d-9fd6-5c3f190a5f84 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.976079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6ee3-e0f8-440d-9fd6-5c3f190a5f84 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:55.977989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 484/961] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:55.984767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d91df-af29-4b3a-b272-6fe954e5965f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:55.985129 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d91df-af29-4b3a-b272-6fe954e5965f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:55.985549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d91df-af29-4b3a-b272-6fe954e5965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.009830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c57d91df-af29-4b3a-b272-6fe954e5965f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:56.011389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c57d91df-af29-4b3a-b272-6fe954e5965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:56.089690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 478/962] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:56.113468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d6ee3-e0f8-440d-9fd6-5c3f190a5f84 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.204996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b89d-577b-4e6d-98d0-7e335911d1d6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.205326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b89d-577b-4e6d-98d0-7e335911d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.205558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b89d-577b-4e6d-98d0-7e335911d1d6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.205849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:56.207425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 479/963] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:56.212775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.213406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.213406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.224900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d6ee3-e0f8-440d-9fd6-5c3f190a5f84 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:56.231826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:56.233365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:56.263482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:56.264283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.264564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.264837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.265637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:56.267160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:56.280212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:56.281294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:56.282876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 485/964] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:56.287846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.298884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:56.312630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 480/965] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:56.337043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.409463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099864c6-c7fc-4a3d-91dc-7bf92bbe812b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:56.444685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:56.445303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787c3c8-8a37-47c9-8bbb-380ce899c7b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:56.445415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.445626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.445899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.446625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:56.446946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:56.448315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:56.453580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 486/966] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:56.458884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.475211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:56.484526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:56.485287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.485818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.486139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.501196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:10:56.510067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:56.511156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:10:56.512032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:56.516374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 481/967] 10.222.0.61 () {56 vars in 1120 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:56.517281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.573702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511afd-23c3-4cb2-9c6c-29286367c6dd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:56.580627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:56.611539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:56.612588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.613417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.613836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.614575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:56.614878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:56.616262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:56.621091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 487/968] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:56.634057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979db79-23fa-4843-ad8d-4d2dcdd563bb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:56.673951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:56.674659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.674941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.675295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.676078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:56.676392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:56.677817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:56.692818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 482/969] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:56.694531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.782640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:56.806317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37511a8a-d2fb-490a-93d4-e9e569cb6e63 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:56.841883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:56.842704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:56.842981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:56.843516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:56.854973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:56.856413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:56.874401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:56.875550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:56.876492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:56.876492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:56.876492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:56.876492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:56.876492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 488/970] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:56.882599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:56.990643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c4d28-4e2e-43bf-a64e-fc8f4dc3ce79 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.008256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.041514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.042114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.042437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.042719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.043456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:57.043912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.045211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.064225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 483/971] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:57.065478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.182174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199fc83-d345-40c4-b878-9e71daed939d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.211499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.219097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.219921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.220197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.220468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.228983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.230467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1afeb723-d7f5-4e59-8103-3206a5931bf6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:10:57.245649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:57.246696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:57.248233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 489/972] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:57.255220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.339144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa104a3-68c3-4065-8cbd-f6613c19a541 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.339475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa104a3-68c3-4065-8cbd-f6613c19a541 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.339906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa104a3-68c3-4065-8cbd-f6613c19a541 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.344847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 490/973] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:10:57.348894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.349316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.349705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.368324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ec93-6b78-431a-8f72-b14d224c6f43 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.369556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:57.370803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:57.406540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.407217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.407502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.407782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.408611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:57.408926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.411028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.434525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 484/974] 10.222.0.61 () {56 vars in 1149 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:57.435736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.448913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 491/975] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:10:57.469316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.477370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.557708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01582c0a-67ff-496b-93bb-4148e9cad6f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.589806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4d040-c457-4f3d-a58a-21347d0b5ca4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.594292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.594952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.595465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.595591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.613307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.631315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.632129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.632412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.632689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.633388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.634842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:57.647032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:57.648155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:10:57.649026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:10:57.653571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 492/976] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:57.655245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.677987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.680105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.712826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.771000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bfee-fd09-4af2-9e77-b19c120446ef None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.793125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 485/977] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:10:57.798753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.809280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.809987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.810272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.810709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.811253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:57.811566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.812952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.818693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 493/978] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:57.824265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:57.882298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.914721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc804-b638-4350-ac19-e8e77518ba98 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.945602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779474f1-ff7c-42af-996a-521a4abd6754 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:57.952762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:57.959486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.960298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.960609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.960850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.973008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.974584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.984655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:57.985401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:57.985676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:57.986020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:57.986806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:57.987116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:57.989165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:57.996147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 494/979] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:10:58.000214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:58.001429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:58.003081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:10:58.003081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:10:58.003081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:10:58.003081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:58.003081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 486/980] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:10:58.004038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:58.010040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:58.136189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46950a-cf40-41dc-acd2-3bd9abf2919e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:58.158542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1096-a8c3-4815-8c79-9d491e8e8f3e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:58.173406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:58.178485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:58.179162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.179439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.179709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.180431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:58.180731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:58.182182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:58.194818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 487/981] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:58.200440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:58.201170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:58.202051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.202482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.202897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.204998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] RBAC: Adding query filter params (interface=admin, service_id=e46d9f0c4fb642aea42ece5411d821c2, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:58.205525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:58.207133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:58.222932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 495/982] 10.222.0.61 () {56 vars in 1249 bytes} [Fri May 27 03:10:58 2022] GET /identity/v3/endpoints?service_id=e46d9f0c4fb642aea42ece5411d821c2&interface=admin®ion_id=RegionOne => generated 193 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:58.223588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:58.259370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:58.327722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163ee3c-a2a5-49d0-89df-142b1021e0c5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:58.346164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba606-8b6f-4be9-a444-14ff24e6a5d8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:58.367656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:58.368461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.368744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.369015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.376245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:58.377789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:58.383676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:58.384345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.384629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.384909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.385587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:58.387060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:10:58.392565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:10:58.393462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:10:58.394431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:10:58.394868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 496/983] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:10:58 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:10:58.395519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 488/984] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:10:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:10:58.400655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:58.449148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:58.525065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73019-dd34-4734-9493-039ad673c782 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:58.563844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:58.564530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.564814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.565092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.566002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:58.566300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:58.568279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b991cb-69da-4af7-b664-6a420fad31ed None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:58.586652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 497/985] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:10:58.587944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:58.697398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5b05a-3854-4390-bf18-2700544a1bb6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:58.700715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:58.738500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:58.739266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.739618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.739961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.740864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] RBAC: Adding query filter params (role.id=69dca09a8aa64afa98e0c6acf659db66, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=6af8f930d4e94212896840b336e6f9cf) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:10:58.741247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:58.742958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a7be-6b15-4739-b50e-385ef70c5e2d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:58.749861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 489/986] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:10:58 2022] GET /identity/v3/role_assignments?user.id=6af8f930d4e94212896840b336e6f9cf&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=69dca09a8aa64afa98e0c6acf659db66 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:10:58.908909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925788a-8b45-443d-9b67-d543aa1c3e99 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.909287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925788a-8b45-443d-9b67-d543aa1c3e99 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.910024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925788a-8b45-443d-9b67-d543aa1c3e99 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.911647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 498/987] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:10:58.917173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3aac0-91c8-4434-83a8-df647d145b43 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:58.917456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3aac0-91c8-4434-83a8-df647d145b43 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:58.917731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3aac0-91c8-4434-83a8-df647d145b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:58.937179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a5a3aac0-91c8-4434-83a8-df647d145b43 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:10:58.938524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a5a3aac0-91c8-4434-83a8-df647d145b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:10:59.011728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 490/988] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:10:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:10:59.034196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925788a-8b45-443d-9b67-d543aa1c3e99 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:10:59.142593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:10:59.147627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925788a-8b45-443d-9b67-d543aa1c3e99 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:10:59.182945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51a61-c4be-43c5-a0a9-fd57c04f918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:10:59.183613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51a61-c4be-43c5-a0a9-fd57c04f918b None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:10:59.183880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51a61-c4be-43c5-a0a9-fd57c04f918b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:10:59.184165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51a61-c4be-43c5-a0a9-fd57c04f918b None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:10:59.184883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51a61-c4be-43c5-a0a9-fd57c04f918b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:10:59.186280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51a61-c4be-43c5-a0a9-fd57c04f918b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:10:59.203342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 499/989] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:10:59 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:00.664333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694450d-a61f-46fd-b50a-af43a5ca166b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:00.664887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694450d-a61f-46fd-b50a-af43a5ca166b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:00.664887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694450d-a61f-46fd-b50a-af43a5ca166b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:00.666484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 491/990] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:00.671523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:00.671917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:00.672114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:00.689396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:00.690683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:00.767689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 500/991] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:00.791521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694450d-a61f-46fd-b50a-af43a5ca166b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:00.900446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:00.906612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694450d-a61f-46fd-b50a-af43a5ca166b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:00.942615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:00.943425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:00.943704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:00.943973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:00.944621 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:00.946026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-29509f61-e123-43a9-8eb2-76c3658bd8bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:00.958385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:00.959450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:11:00.960308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:00.962324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 492/992] 10.222.0.61 () {56 vars in 1126 bytes} [Fri May 27 03:11:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:00.965602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.020272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8603e8e-d0ed-4908-b1a5-5a446f3bd7ae None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.020500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8603e8e-d0ed-4908-b1a5-5a446f3bd7ae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.020840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8603e8e-d0ed-4908-b1a5-5a446f3bd7ae None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.022396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 493/993] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:11:01.027595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.027921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.028198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.048336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:01.050488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:01.072663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:01.094256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4539b0-0bb4-4b7d-86f0-4cd0fc25d2cc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.131462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.132138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.132422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.134006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.134137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 494/994] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:01.134222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:01.134222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.135238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.146002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 501/995] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:11:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:01.147783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.155342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.263268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:01.266414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aacdaf-0d80-4fe1-8921-f619b1c0c593 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.280891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90ea9-e002-4f52-adfb-3cb3704ded3a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.303634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.304459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.304739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.305019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] PATH_INFO: `/v3/services/image` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.305668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.307069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:01.319489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:01.320561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:01.322053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 502/996] 10.222.0.61 () {56 vars in 1105 bytes} [Fri May 27 03:11:01 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:11:01.326548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.328866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.329531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.329810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.330117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.330809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:01.331106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.333103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.338436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 495/997] 10.222.0.61 () {56 vars in 1122 bytes} [Fri May 27 03:11:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:01.344164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.350715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:01.450119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cc6cf-4d35-4182-be9b-89701d5a9f95 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.459276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d259-1206-4312-ab65-a631a1c055a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.485690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.486403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.486684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.486960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.488257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:01.488705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.489989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff1c50-ee5b-4793-b639-a3b75f4420fc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.495456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 503/998] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:01.496095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b8a82-2fcc-4f5e-b4e0-23ab50b12c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.496693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b8a82-2fcc-4f5e-b4e0-23ab50b12c24 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.496884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f0dc-7e9f-49d7-9d58-eac5887be768 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.496983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b8a82-2fcc-4f5e-b4e0-23ab50b12c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.497176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f0dc-7e9f-49d7-9d58-eac5887be768 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.497286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b8a82-2fcc-4f5e-b4e0-23ab50b12c24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.497447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f0dc-7e9f-49d7-9d58-eac5887be768 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.497947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b8a82-2fcc-4f5e-b4e0-23ab50b12c24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.498858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 504/999] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:01.499334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b8a82-2fcc-4f5e-b4e0-23ab50b12c24 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.501231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482f0dc-7e9f-49d7-9d58-eac5887be768 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.515798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 496/1000] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:11:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:11:01.517083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.517368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.517640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.546420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:01.547566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:01.562131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:01.599203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:01.641575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482f0dc-7e9f-49d7-9d58-eac5887be768 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.647159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 497/1001] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:01.674186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:01.688863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.689627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.689838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.690150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.690873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:01.691242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.693432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.702558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 505/1002] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:01.833560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138ca8-887d-4002-829a-ef8be05b1210 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:01.879294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:01.880201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:01.880408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:01.880687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:01.881360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:01.882842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:01.896066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:01.897342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:01.899716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 498/1003] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:11:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:01.904276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:02.029811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2d665-421d-4631-ae3c-7c1302d7d5a8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:02.066336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:02.066961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:02.067263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:02.067529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:02.068250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:02.068551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:02.069943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:02.075676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 506/1004] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:11:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:02.082684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:02.099144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:02.216744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f663b-7182-4ef8-b559-1dddcde1167e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:02.259074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:02.259785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:02.260176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:02.260481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:02.261313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:02.261620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:02.263210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:02.274537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 499/1005] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:11:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:02.276171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:02.279582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:02.393419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11686-753a-408d-aacd-556b593cefd7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:02.430389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:02.431115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:02.431434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:02.431640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:02.432415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] RBAC: Adding query filter params (interface=public, service_id=aa78d3339dfd42ec9eae4dd0382f5b8c, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:02.432727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:02.434144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccecf1-86e0-46fd-875d-03715775363e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:02.445199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 507/1006] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:11:02 2022] GET /identity/v3/endpoints?service_id=aa78d3339dfd42ec9eae4dd0382f5b8c&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:02.447136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:02.545866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:02.574531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9a68-3257-49be-b111-c2e4be0413c8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:02.615070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cae4d-6853-4e51-ad66-5b6705eb56be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:02.615977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cae4d-6853-4e51-ad66-5b6705eb56be None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:02.616265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cae4d-6853-4e51-ad66-5b6705eb56be None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:02.616547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cae4d-6853-4e51-ad66-5b6705eb56be None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:02.617238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cae4d-6853-4e51-ad66-5b6705eb56be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:02.618998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cae4d-6853-4e51-ad66-5b6705eb56be None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:02.626838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 500/1007] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:11:02 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:11:03.954788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fe9af-457f-46db-98f2-ef11d315427f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:03.955328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fe9af-457f-46db-98f2-ef11d315427f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:03.955328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fe9af-457f-46db-98f2-ef11d315427f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:03.956757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 508/1008] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:03.963150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa550-c7a0-4a4f-92a8-293568d146e9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:03.963715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa550-c7a0-4a4f-92a8-293568d146e9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:03.963715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa550-c7a0-4a4f-92a8-293568d146e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:03.981384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b1baa550-c7a0-4a4f-92a8-293568d146e9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:03.982624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b1baa550-c7a0-4a4f-92a8-293568d146e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:04.058604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 501/1009] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:04.082330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fe9af-457f-46db-98f2-ef11d315427f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:04.105454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a44d7-8480-4445-9e02-2d93bf2d9aae None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:04.105803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a44d7-8480-4445-9e02-2d93bf2d9aae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:04.106052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a44d7-8480-4445-9e02-2d93bf2d9aae None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:04.107675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 502/1010] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:11:04.113985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:04.114321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:04.114544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:04.133329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:04.134536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:04.164100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:04.204902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fe9af-457f-46db-98f2-ef11d315427f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:04.223387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:04.234059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 503/1011] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:04 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:04.243286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:04.244101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:04.244410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:04.244685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:04.246006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:04.247622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:04.249510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 509/1012] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:04.256096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:04.257292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:04.379421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c52b25-1497-4494-a04e-5b26c52cf120 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:04.383694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9cd4b-0983-47bd-8cc0-a2e5a782a8b2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:04.426502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08153f0c-b6e5-4925-a82e-a5e0751a80de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:04.427242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08153f0c-b6e5-4925-a82e-a5e0751a80de None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:04.427567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08153f0c-b6e5-4925-a82e-a5e0751a80de None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:04.427800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08153f0c-b6e5-4925-a82e-a5e0751a80de None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:04.428672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08153f0c-b6e5-4925-a82e-a5e0751a80de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:04.430202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08153f0c-b6e5-4925-a82e-a5e0751a80de None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:04.431234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c58d9-ef8c-4170-aa47-88d21e843012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:04.431860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c58d9-ef8c-4170-aa47-88d21e843012 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:04.432171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c58d9-ef8c-4170-aa47-88d21e843012 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:04.432467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c58d9-ef8c-4170-aa47-88d21e843012 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:04.432681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:04.433197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c58d9-ef8c-4170-aa47-88d21e843012 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:04.434800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c58d9-ef8c-4170-aa47-88d21e843012 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:04.446870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 510/1013] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:11:04 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:04.478111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 504/1014] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:11:04 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:05.044310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137fbe-f022-450f-bf2d-5ecc1c5cb153 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:05.044844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137fbe-f022-450f-bf2d-5ecc1c5cb153 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:05.045259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137fbe-f022-450f-bf2d-5ecc1c5cb153 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:05.047880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 511/1015] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:05.056366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:05.057002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:05.057002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:05.075558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:05.076939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:05.135657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:05.172678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 505/1016] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:05 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:05.198520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4137fbe-f022-450f-bf2d-5ecc1c5cb153 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:05.320483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4137fbe-f022-450f-bf2d-5ecc1c5cb153 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:05.358711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:05.359553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:05.359871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:05.360175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:05.360816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:05.362256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:05.375070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:05.376227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:11:05.377161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:05.381409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 512/1017] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:11:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:05.382674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:05.507606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be072d81-ec7f-4253-b9c8-bc597ef1d27e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:05.547712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:05.548382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:05.548667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:05.548942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:05.549666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:05.550598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:05.551905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:05.562007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 506/1018] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:11:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:05.563571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:05.634583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:05.686497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149b38-b65b-4ef4-a47c-8591523dec6d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:05.729279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:05.730440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:05.730945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:05.731439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:05.732757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:05.733388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:05.735933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c248e-43c3-4afa-9b63-5759e9fb6163 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:05.745354 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 513/1019] 10.222.0.61 () {56 vars in 1112 bytes} [Fri May 27 03:11:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:05.751654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:05.810182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:05.878406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010c511-ad8a-4f65-bb13-8fede896ffb8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:05.917861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4303f3-98e2-4cc3-aa74-e188494d9689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:05.918477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4303f3-98e2-4cc3-aa74-e188494d9689 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:05.918762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4303f3-98e2-4cc3-aa74-e188494d9689 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:05.919040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4303f3-98e2-4cc3-aa74-e188494d9689 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:05.919791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4303f3-98e2-4cc3-aa74-e188494d9689 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:05.921166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4303f3-98e2-4cc3-aa74-e188494d9689 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:05.941825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 507/1020] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:11:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:06.923091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031989-89ef-4346-a08c-0a4ab590e4bf None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:06.923597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031989-89ef-4346-a08c-0a4ab590e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:06.923714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031989-89ef-4346-a08c-0a4ab590e4bf None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:06.926037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 514/1021] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:06.931368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:06.931822 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:06.931901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:06.949871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:06.951082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:06.997629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2f8d-bf3a-439f-b67a-6a8d5fac9245 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:06.997948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2f8d-bf3a-439f-b67a-6a8d5fac9245 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:06.998247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2f8d-bf3a-439f-b67a-6a8d5fac9245 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:06.999905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 515/1022] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:11:07.006086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.006366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.006639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.023797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:07.024993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:07.034826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 508/1023] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:07.057752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.083794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:07.120052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 516/1024] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:07.145351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.172769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2612cbf-2e2b-4171-84a4-3c5e5e70703a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:07.205226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:07.218846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:07.219636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.219912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.220336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.220979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:07.223191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:07.238324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:07.239401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:07.245760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 509/1025] 10.222.0.61 () {56 vars in 1105 bytes} [Fri May 27 03:11:07 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:11:07.246655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.256134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86677-6522-417d-bb4d-b8f66446d526 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:07.298463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:07.299432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.299748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.300310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.301540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:07.303489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:07.312618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 517/1026] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:07.314660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.345105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:07.363783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2d37-d06f-4cf5-8865-7eef4c463da2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:07.415039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:07.415759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.416311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.416617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.417433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] RBAC: Adding query filter params (name=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:07.417758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:07.419543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:07.425594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 510/1027] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:07.432649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.444625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050a22-bf97-4cdf-9f53-7b98c438068c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:07.471329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:07.498605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:07.499358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.499643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.500042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.500865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:07.503194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:07.532657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 518/1028] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:11:07 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:07.599163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815f89-b265-40be-bf11-10046f13e3ee None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:07.653867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:07.654762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.655124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.655422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.656339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] RBAC: Adding query filter params (type=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:07.656659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:07.658415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:07.671050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 511/1029] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:07.672799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.804612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c10f4-c445-4244-b70b-17831da7b123 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:07.846053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:07.846819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:07.847164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:07.847412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:07.848205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] RBAC: Adding query filter params (interface=public, service_id=c30117981ab54bf2bf16b70d79d0b43e, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:07.848515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:07.850106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c07b-aee7-4171-bb85-e2d295db9a5d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:07.856715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 519/1030] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:11:07 2022] GET /identity/v3/endpoints?service_id=c30117981ab54bf2bf16b70d79d0b43e&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:07.863026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:07.882207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:07.975404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277d9ef-c801-42be-91ab-5e8f428a9d22 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:08.012580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250d9a4-39c3-4d20-844c-1e9792f95fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:08.013258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d9a4-39c3-4d20-844c-1e9792f95fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:08.013566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d9a4-39c3-4d20-844c-1e9792f95fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:08.013888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d9a4-39c3-4d20-844c-1e9792f95fe0 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:08.014558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250d9a4-39c3-4d20-844c-1e9792f95fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:08.015979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250d9a4-39c3-4d20-844c-1e9792f95fe0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:08.030063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 512/1031] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:11:07 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:11:08.349090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c256-ff01-43a4-a7cb-c9d118342330 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:08.349666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c256-ff01-43a4-a7cb-c9d118342330 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:08.349758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c256-ff01-43a4-a7cb-c9d118342330 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:08.351676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 520/1032] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:08.357459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:08.357757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:08.358074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:08.375787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:08.376980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:08.455158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 513/1033] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:08.478810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c256-ff01-43a4-a7cb-c9d118342330 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:08.542083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:08.626537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5c256-ff01-43a4-a7cb-c9d118342330 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:08.673047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:08.673873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:08.674206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:08.674522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:08.685919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:08.696601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:08.697735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:11:08.699477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:08.702382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 521/1034] 10.222.0.61 () {56 vars in 1120 bytes} [Fri May 27 03:11:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:08.704846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:08.720039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:08.828573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e76b8a-0b66-478d-a30c-b769b7afc6ec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:08.867463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:08.868144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:08.868419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:08.868688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:08.869428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:08.869727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:08.871124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:08.884417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 514/1035] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:11:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:08.890161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:09.000323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:09.006257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551e663-2fca-402d-a1fe-b1bc0780caa6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:09.045029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:09.045840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.046179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.046456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:09.062145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:09.064855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:09.091094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:09.092264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:09.093694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:09.093694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:09.093694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:09.093694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:09.099368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 522/1036] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:09.101330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:09.181211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:09.213476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e58c4-9d53-4331-bcad-be4d37e5c077 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:09.251153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:09.251825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.252111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.252393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:09.253176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:09.253487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:09.254908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:09.267450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 515/1037] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:09.273597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:09.380232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a663-d36c-4d9d-9125-c669a55e62ca None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:09.417545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:09.418387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.418678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.418947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:09.427587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:09.429058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:11:09.443679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:09.444966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:09.445978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 523/1038] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:11:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:09.450576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:09.588689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ce61-076d-4f22-8d4b-bf6b3ffd96a5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:09.645379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:09.657565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:09.658799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.659327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.659821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:09.661429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:09.661994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:09.665048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623fbf2-c6d3-401d-aa50-180335261d85 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:09.704845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 516/1039] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:11:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:09.706970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:09.728680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:09.830444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a4e8c-36bf-4313-835f-0578818e693c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:09.869208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:09.870005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.870305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.870643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:09.947126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:09.948744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:09.967071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:09.982622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f24e-5ca7-4507-813d-59f18ea3f8d0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.983073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f24e-5ca7-4507-813d-59f18ea3f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.983224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f24e-5ca7-4507-813d-59f18ea3f8d0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:09.985066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 517/1040] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:11:09.990836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:09.991265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:09.991661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.011835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:10.013174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:10.085558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 524/1041] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:10.093090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.098393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 518/1042] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:10.137891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.244923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8e17a-0cb7-43d0-9869-574b6687deca None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.259856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:10.270150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293dcd4-47a8-433b-a770-915662ef7875 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.284048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.284864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.285147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.285421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.288088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:10.297217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.298727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.308116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.308912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.309190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.309456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:10.319465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:10.320412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:10.321338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:10.321338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:10.321338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:10.321338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:10.321338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 525/1043] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:11:10.322826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:10.326083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:10.330486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:10.332196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:10.333066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 519/1044] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:10.338163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.439811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182facbc-617a-4d6d-b76c-3a8167e48a25 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.452295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3402-2794-407b-a492-47b10125abfe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.475103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.475766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.476045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.476321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.477026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:10.477328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.478720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a859649-6efb-4ec2-b24f-187866c20652 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.486836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.487625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.487913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.488194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.488944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:10.489250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.490682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c08a6b-a662-47e0-8d5c-d9b5498be3b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.491329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 526/1045] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:10.493284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb45f-7fb8-4d82-b92f-13343f5cbc1e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.493284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb45f-7fb8-4d82-b92f-13343f5cbc1e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.493456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb45f-7fb8-4d82-b92f-13343f5cbc1e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.494648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 527/1046] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:10.498901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb45f-7fb8-4d82-b92f-13343f5cbc1e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.505142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 520/1047] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:10.509334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.509334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.509334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.525303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:10.526513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:10.526657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:10.562034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:10.599878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 521/1048] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:10.600773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.612439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb45f-7fb8-4d82-b92f-13343f5cbc1e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.646310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.647110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.647388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.647660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.654283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.655725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:11:10.669818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:10.670985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:10.671999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 528/1049] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:10.675430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.706993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a904a6e-d550-4cb1-85ee-997d220f7b19 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.743525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.744407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.744687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.744970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] PATH_INFO: `/v3/users/de3303d019134aff95fa8d543d0aa989` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.759368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] RBAC: Authorizing `identity:get_user(user_id=de3303d019134aff95fa8d543d0aa989)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.760960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.767708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 522/1050] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/users/de3303d019134aff95fa8d543d0aa989 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:10.767878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:10.768000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.785439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3771c-db5c-493d-aa98-dfcb204a8c39 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.795452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:10.824542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.825900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.826201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.826470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] PATH_INFO: `/v3/services/image` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.827120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.828506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:10.840989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:10.849533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:10.850535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 529/1051] 10.222.0.61 () {56 vars in 1105 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:10.851408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.875707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550a3f-ce27-4552-9bf2-11fff6b996cd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:10.914439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:10.915151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:10.915526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:10.915809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:10.916678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:10.917033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:10.918840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:10.931935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 523/1052] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:10.932796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:10.964664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f04b-592e-4473-a3fa-dfe90920451f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.003206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.003863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.004144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.004426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.023845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:11.033626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:11.053613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993764d-1958-4b1e-b072-2d50ffda22c3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.082638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.084115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.092296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.093238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.093521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.093793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.094534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] RBAC: Adding query filter params (name=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:11.094866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.096978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.102233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 524/1053] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:11.103028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:11.192976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 530/1054] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:11.193838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:11.213728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525998ed-63c4-4000-88ac-065ae5f9c84c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.256569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:11.260196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.260859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.261296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.261606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.262562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] RBAC: Adding query filter params (role.id=69dca09a8aa64afa98e0c6acf659db66, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=9799f9d11546403e8b46ad386be470d8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:11.262886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.264508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.271277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 525/1055] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:11 2022] GET /identity/v3/role_assignments?user.id=9799f9d11546403e8b46ad386be470d8&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=69dca09a8aa64afa98e0c6acf659db66 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:11.272227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:11.300298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:11.327474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3917c-d6ce-4243-85dc-447806fdc27c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.384520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.385373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.385719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.386094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.386884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] RBAC: Adding query filter params (type=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:11.387192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.388796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.399321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 531/1056] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:11.400623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:11.416960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70288250-e593-4626-aeee-01d6dee563ad None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.457294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.458248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.458538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.458816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.460089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] RBAC: Authorizing `identity:get_project(project_id=3eff040bc9ed40409cf76cc38b760a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.461552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.468673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 526/1057] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:11 2022] GET /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:11.470683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:11.534787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81088f1-3131-48bb-ab7b-d06118500202 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.546016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:11.575125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2e9a4-b7b7-42db-b14e-ad1a0f373262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.576138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2e9a4-b7b7-42db-b14e-ad1a0f373262 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.576591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2e9a4-b7b7-42db-b14e-ad1a0f373262 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.577011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2e9a4-b7b7-42db-b14e-ad1a0f373262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.578080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2e9a4-b7b7-42db-b14e-ad1a0f373262 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.579732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2e9a4-b7b7-42db-b14e-ad1a0f373262 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.586117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:11.603309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 532/1058] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:11:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:11:11.610107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31cb4b-da56-4629-9c7e-d57245006c25 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:11.669700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:11.671029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:11.671562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:11.672089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:11.673415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=3eff040bc9ed40409cf76cc38b760a5a, user.id=de3303d019134aff95fa8d543d0aa989) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:11.674010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:11.676901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7d27-7932-4cde-a1ef-e6bcbdb2b8b3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:11.687273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 527/1059] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:11 2022] GET /identity/v3/role_assignments?user.id=de3303d019134aff95fa8d543d0aa989&scope.project.id=3eff040bc9ed40409cf76cc38b760a5a&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:13.594976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7b6f-073a-446d-91a4-d384039eec7a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:13.595534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7b6f-073a-446d-91a4-d384039eec7a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:13.595534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7b6f-073a-446d-91a4-d384039eec7a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:13.597521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 533/1060] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:13.603815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:13.604327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:13.604506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:13.622070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:13.623502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:13.699284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 528/1061] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:13.726786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd7b6f-073a-446d-91a4-d384039eec7a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:13.851827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd7b6f-073a-446d-91a4-d384039eec7a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:13.894526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ac43a-9a1a-4cd5-beb5-03e70ff26baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:13.895652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ac43a-9a1a-4cd5-beb5-03e70ff26baa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:13.896069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ac43a-9a1a-4cd5-beb5-03e70ff26baa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:13.896440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ac43a-9a1a-4cd5-beb5-03e70ff26baa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:13.912359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ac43a-9a1a-4cd5-beb5-03e70ff26baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7c1ac43a-9a1a-4cd5-beb5-03e70ff26baa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:13.922663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:13.923788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:13.933685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 534/1062] 10.222.0.61 () {56 vars in 1120 bytes} [Fri May 27 03:11:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:13.934606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:13.981696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b971-6c2b-4022-aa43-8744c2237541 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:13.981988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b971-6c2b-4022-aa43-8744c2237541 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:13.982300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b971-6c2b-4022-aa43-8744c2237541 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:13.983763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 535/1063] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:11:13.991255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8b96-d20f-4fbc-bd75-cdfbd0052ba5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:13.991643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8b96-d20f-4fbc-bd75-cdfbd0052ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:13.991796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8b96-d20f-4fbc-bd75-cdfbd0052ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.011276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b52a8b96-d20f-4fbc-bd75-cdfbd0052ba5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:14.013026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b52a8b96-d20f-4fbc-bd75-cdfbd0052ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:14.041108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.041337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.070651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b36e73-2020-4ae4-b1f9-d0a3ed14e7b2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.094550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 536/1064] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:14.095909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5350-24df-4c42-8537-f1e3f2d32bb8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.096223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5350-24df-4c42-8537-f1e3f2d32bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.096506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5350-24df-4c42-8537-f1e3f2d32bb8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.097796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 537/1065] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:14.103454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.103636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.103843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.119328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.120741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:14.122211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:14.122400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.122618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.123058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.123946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:14.124262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.125666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.134982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 529/1066] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:11:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:14.135815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.202169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 538/1067] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:14.203051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.256140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282cfed-f34a-4f3f-8c4d-cd60c25aa02b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.296377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.297118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.297400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.297671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.302248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.304270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.318262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701bdee-eba8-4673-93a2-043ace158fc2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.359339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.360046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.360328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.360609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.371490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.372986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.379913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.381368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:14.394903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:14.396004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:14.397030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:14.397030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:14.397030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:14.397030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:14.397030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 539/1068] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:14.397030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.501186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 530/1069] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:14.501480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f950e1-b436-4ac2-a864-416461e0d16b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.502036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.542814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.549067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.549067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.549067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.549067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.560354 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.564323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:14.572308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:14.573570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 540/1070] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:14.574775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.628410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e587639-90b2-4c6d-ad5d-b1107798b7ae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.664931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.665596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.665878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.666189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.666903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:14.667211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.668610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.680937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 531/1071] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:14.681662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.686121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f65025-555b-4507-9cc1-97a718752605 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.729607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.730452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.730738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.731024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.742652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.744130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:14.763489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:14.764553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:14.765485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:14.765485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:14.765485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:14.765485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:14.765485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 541/1072] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:14.765774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.788381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.796522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba9684-bb86-46d2-9cdd-f75db86661fd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.833189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:14.840904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.841585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.841864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.842176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.843175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:14.843476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.844850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.855239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 532/1073] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:14.856306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.888732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af68ae-f874-4cae-9a3e-ec5eff83d691 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:14.928881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:14.929677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:14.929970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:14.930249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:14.938405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:14.939855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:11:14.954860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:14.956786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 542/1074] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:14.958795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:14.985801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70fa2e-e5b0-42af-a474-101284cb1f09 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.031721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.032511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.032796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.033135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.033832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:15.034172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.035576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.048769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 533/1075] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:15.049609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.072708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:15.090360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94bd0f-c898-4a28-8ac0-36d8bd9df29b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.109334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:15.138087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.139960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.141012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.141552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] PATH_INFO: `/v3/users/de3303d019134aff95fa8d543d0aa989` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.144672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] RBAC: Authorizing `identity:get_user(user_id=de3303d019134aff95fa8d543d0aa989)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.146858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.149320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 543/1076] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:14 2022] GET /identity/v3/users/de3303d019134aff95fa8d543d0aa989 => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:15.162104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.201811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfde45-911f-47ce-9218-52083597f116 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.257669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.259164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.259164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.259164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.260133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:15.260133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.261704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.282544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 534/1077] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:11:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:15.292416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.314947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add49cce-8a51-42ec-8e50-5684c7b560c9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.369919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.371759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.372268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.372998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.375329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] RBAC: Authorizing `identity:get_project(project_id=3eff040bc9ed40409cf76cc38b760a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.377028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.379379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 544/1078] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:15 2022] GET /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a => generated 311 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:15.386528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.397379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:15.417849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a3f3e-da35-4353-8d59-59a88044e3f9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.445462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:15.454556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.456001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.456288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.456561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.468541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.470032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:15.491029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:15.492045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:15.492977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:15.492977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:15.492977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:15.492977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:15.492977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 535/1079] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:15.498467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.512250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40117f13-d0ed-4ea5-a6f0-a2139347ba90 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.548975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.550492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.550814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.551032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a/users/de3303d019134aff95fa8d543d0aa989/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.558607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] RBAC: Authorizing `identity:create_grant(project_id=3eff040bc9ed40409cf76cc38b760a5a, user_id=de3303d019134aff95fa8d543d0aa989, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.560228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.573858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 545/1080] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:11:15 2022] PUT /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a/users/de3303d019134aff95fa8d543d0aa989/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:11:15.629205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04566494-b774-4749-8f18-9eaf6eed9c26 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.661256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:15.672242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.673072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.673435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.673803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.675222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:15.675572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.677272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.693044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 536/1081] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:15.698807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.813521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a17ac-638f-4fe6-aa15-330997f48b64 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:15.823441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:15.853393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:15.854243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:15.854532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:15.854810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:15.861920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:15.863407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:11:15.878259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:15.879243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:15.880183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 546/1082] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:15.885255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:15.992035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1e8b-6791-45ab-952c-9ce9059183c9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:16.032235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:16.033072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:16.033345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:16.033898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:16.034696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:16.035003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:16.036713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308325ed-6c3b-4e99-8e52-3382ad699976 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:16.050828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 537/1083] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:16.058015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:16.166569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7055-9d2e-4c0e-a7e0-dec8a0f9361e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:16.208076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ccb5b-0f28-4d60-a9b8-7f7669de74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:16.208971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ccb5b-0f28-4d60-a9b8-7f7669de74f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:16.209251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ccb5b-0f28-4d60-a9b8-7f7669de74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:16.209525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ccb5b-0f28-4d60-a9b8-7f7669de74f9 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/9799f9d11546403e8b46ad386be470d8/roles/69dca09a8aa64afa98e0c6acf659db66` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:16.211773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ccb5b-0f28-4d60-a9b8-7f7669de74f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=9799f9d11546403e8b46ad386be470d8, role_id=69dca09a8aa64afa98e0c6acf659db66)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:16.213226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ccb5b-0f28-4d60-a9b8-7f7669de74f9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:16.227739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 547/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:11:16 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/9799f9d11546403e8b46ad386be470d8/roles/69dca09a8aa64afa98e0c6acf659db66 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:11:17.865636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bc550-ed27-454e-98ed-4ae212733e54 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:17.866201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bc550-ed27-454e-98ed-4ae212733e54 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:17.866201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bc550-ed27-454e-98ed-4ae212733e54 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:17.867773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 538/1085] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:17.874744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:17.875204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:17.875423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:17.893481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:17.894710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:17.919112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:17.975367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 548/1086] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:18.001444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bc550-ed27-454e-98ed-4ae212733e54 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:18.058098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:18.114043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bc550-ed27-454e-98ed-4ae212733e54 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:18.152823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:18.153530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.153810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.154118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.165635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:18.173385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:18.174519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:18.175395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 539/1087] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:18.180861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:18.300418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f5989-81fb-44f0-a2d6-f5ef21c63b4d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:18.342358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:18.343575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.343911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.344324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.345626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:18.346779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:18.348507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:18.358863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 549/1088] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:18.365717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:18.470108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f3438-8cf8-4abc-bfda-177a66d5dd00 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:18.479771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:18.512228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8182dd-e5be-4e36-be04-4d7e322fb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:18.513119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8182dd-e5be-4e36-be04-4d7e322fb095 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.513405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8182dd-e5be-4e36-be04-4d7e322fb095 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.513682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8182dd-e5be-4e36-be04-4d7e322fb095 None admin] PATH_INFO: `/v3/users/de3303d019134aff95fa8d543d0aa989` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.514932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8182dd-e5be-4e36-be04-4d7e322fb095 None admin] RBAC: Authorizing `identity:get_user(user_id=de3303d019134aff95fa8d543d0aa989)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:18.516380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8182dd-e5be-4e36-be04-4d7e322fb095 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:18.518367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 540/1089] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/users/de3303d019134aff95fa8d543d0aa989 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:18.523988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:18.552656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:18.577509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc92fd3-a1fb-4cd0-af86-447cd02e27b2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.577794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc92fd3-a1fb-4cd0-af86-447cd02e27b2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.578109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc92fd3-a1fb-4cd0-af86-447cd02e27b2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.579499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 541/1090] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:18.584517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.585120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.585394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.610077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:18.612366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:18.633039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef92a3-4c20-4663-a624-699e446aa8ac None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:18.669033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:18.669657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.670151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.670409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.689401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 542/1091] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:18.714999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:18.751728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:18.753807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:18.784217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:18.833813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e48b-d09e-4122-bc39-39c4424f17cf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:18.842152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:18.877055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:18.878447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:18.878732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:18.879011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:18.884313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 550/1092] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:18.890779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:18.895576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:18.904033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:18.905417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:18.906762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 543/1093] 10.222.0.61 () {56 vars in 1120 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:11:18.911449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.016594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905954c-22e9-4eff-b918-577a20d1210f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.028406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8ce9-e414-40f2-96de-e24d5e753f73 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.041553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:19.056642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.057518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.058053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.058335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.059894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] RBAC: Authorizing `identity:get_project(project_id=3eff040bc9ed40409cf76cc38b760a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.061388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.063345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 551/1094] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:19.069548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.070271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.070546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.070858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.071301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.071714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:19.072084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.073455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.088747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 544/1095] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:11:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:19.090308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.120414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:19.184669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21addabd-5c79-4d3e-a631-8e32f5addd68 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.212661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8ec7f-cfa5-47d0-9b63-7d154b95a3db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.224461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.225095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.225412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.225870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.226588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=3eff040bc9ed40409cf76cc38b760a5a, user.id=de3303d019134aff95fa8d543d0aa989) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:19.226965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.228522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.238102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 552/1096] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:19 2022] GET /identity/v3/role_assignments?user.id=de3303d019134aff95fa8d543d0aa989&scope.project.id=3eff040bc9ed40409cf76cc38b760a5a&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:19.251314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.252188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.252485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.252769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.267649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.269642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:19.289628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:19.290949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:19.291883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:19.291883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:19.291883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:19.291883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:19.291883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 545/1097] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:11:19.296889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.364073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:19.424965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6e8f-3ad6-43d5-ac77-feb1207339dd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.463096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.463690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.463975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.464252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.464969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:19.465279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.466736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.479945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 553/1098] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:19.486147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.582086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:19.606969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fee11-1f7e-4ece-b1e4-61bbc7640087 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.643792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.644579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.644855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.645125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.656699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.658246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:11:19.673552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:19.674832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:19.675839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 546/1099] 10.222.0.61 () {56 vars in 1093 bytes} [Fri May 27 03:11:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:11:19.681614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.796714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832fb3-bdb3-4ba8-8602-75acbf2fa637 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:19.811574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:19.837757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:19.838490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:19.838885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:19.839186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:19.840231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:19.840544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:19.842202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:19.864433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 554/1100] 10.222.0.61 () {56 vars in 1133 bytes} [Fri May 27 03:11:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:19.871258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:19.976980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23cc5-76a3-4fbb-8cbc-667f05cff890 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:20.016507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:20.017172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:20.017493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:20.018359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:20.031187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:20.094100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:20.095478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:20.206790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 547/1101] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:11:20.213020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:20.320758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6a78-3bab-436b-a454-2f2f4c8eacb7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:20.358604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:20.359378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:20.359658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:20.359930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:20.372473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:20.374111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:20.394392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:20.395896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:20.397243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:11:20.397243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:20.397243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:11:20.397243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:20.397243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 555/1102] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:20.402234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:20.464565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:20.548818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c1dc2-9670-4536-8754-65617170f87c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:20.599661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:20.600325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:20.600610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:20.600885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:20.601606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:20.601916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:20.603319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:20.615280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 548/1103] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:20.620804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:20.646039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:20.727724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911565c-f598-4f7b-9b25-94d0faf09497 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:20.764073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:20.764868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:20.765154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:20.765425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:20.773254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:20.774755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:11:20.788866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:20.789927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:20.791547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 556/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:20.796029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:20.908813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:20.912158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13290d4-3247-44cc-ab69-64beb061566d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:20.949057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:20.949730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:20.950045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:20.950318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:20.951109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:20.951415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:20.952901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c5566-45c4-464d-af35-231e887af2ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:20.966576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 549/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:20.973617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:21.073412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:21.094785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684fb82-bca6-4670-8c68-fe975ad5679a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:21.130511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:21.131175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:21.131452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:21.131720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:21.132559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] RBAC: Adding query filter params (role.id=69dca09a8aa64afa98e0c6acf659db66, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=9799f9d11546403e8b46ad386be470d8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:21.132867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:21.134378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a53b3b-9307-4e70-ad98-e13c5d3994c4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:21.141010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 557/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:20 2022] GET /identity/v3/role_assignments?user.id=9799f9d11546403e8b46ad386be470d8&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=69dca09a8aa64afa98e0c6acf659db66 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:21.644360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0706-13fe-4f5b-8d45-8039997396b7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:21.644876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0706-13fe-4f5b-8d45-8039997396b7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:21.644965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0706-13fe-4f5b-8d45-8039997396b7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:21.646326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 550/1107] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:21.651931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:21.652374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:21.652496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:21.672216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:21.673426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:21.749808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 558/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:21.775510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0706-13fe-4f5b-8d45-8039997396b7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:21.885136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0706-13fe-4f5b-8d45-8039997396b7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:21.919367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c5d9d-0f4f-402b-b8ba-38b4718e07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:21.920145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c5d9d-0f4f-402b-b8ba-38b4718e07c8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:21.920430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c5d9d-0f4f-402b-b8ba-38b4718e07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:21.920707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c5d9d-0f4f-402b-b8ba-38b4718e07c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:21.921900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c5d9d-0f4f-402b-b8ba-38b4718e07c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:21.923388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c5d9d-0f4f-402b-b8ba-38b4718e07c8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:21.925641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 551/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:21.931839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:22.023169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:22.052255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3a17-99ce-4a40-9352-cefc90181d19 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:22.088670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e593d-e73f-47cf-9bcf-52641c3ea788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:22.089380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e593d-e73f-47cf-9bcf-52641c3ea788 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:22.089631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e593d-e73f-47cf-9bcf-52641c3ea788 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:22.089910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e593d-e73f-47cf-9bcf-52641c3ea788 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:22.090651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e593d-e73f-47cf-9bcf-52641c3ea788 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:22.092086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e593d-e73f-47cf-9bcf-52641c3ea788 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:22.112738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 559/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:11:21 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:24.351925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312304-02c0-49bc-990c-d9efaf7fbe2c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:24.352461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312304-02c0-49bc-990c-d9efaf7fbe2c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:24.352461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312304-02c0-49bc-990c-d9efaf7fbe2c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:24.353826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 552/1111] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:24.359198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:24.359582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:24.359759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:24.377095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:24.378323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:24.446982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 560/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:24.471569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312304-02c0-49bc-990c-d9efaf7fbe2c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:24.499458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:24.574763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312304-02c0-49bc-990c-d9efaf7fbe2c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:24.611854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:24.612623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:24.612905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:24.613179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] PATH_INFO: `/v3/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:24.614691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] RBAC: Authorizing `identity:get_role(role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:24.616073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:24.617473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 553/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:24 2022] GET /identity/v3/roles/625fb35ccd424520a9a0766b1d193e60 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:24.623334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:24.690913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:24.732876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ced1d0-5811-4360-a880-c056dcfa1243 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:24.771031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:24.771908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:24.772288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:24.772662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] PATH_INFO: `/v3/users/7d040b49ca5d480396ec030d34b7450f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:24.788608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] RBAC: Authorizing `identity:get_user(user_id=7d040b49ca5d480396ec030d34b7450f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:24.790095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:24.791810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 561/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:24 2022] GET /identity/v3/users/7d040b49ca5d480396ec030d34b7450f => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:24.797634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:24.900648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:24.906972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14817527-d01c-4966-abc6-257f1f455631 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:24.945181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:24.945880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:24.946192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:24.946473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:25.027907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:25.029528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:25.132895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:25.140678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 554/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:25.146894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:25.253452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193889a7-b31f-42d4-85da-b9f080e7c760 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:25.275496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:25.290557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fc9b9-eba4-4396-94ad-7dcddcc295f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:25.291423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc9b9-eba4-4396-94ad-7dcddcc295f5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:25.291700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc9b9-eba4-4396-94ad-7dcddcc295f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:25.291978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc9b9-eba4-4396-94ad-7dcddcc295f5 None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:25.293161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fc9b9-eba4-4396-94ad-7dcddcc295f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3eff040bc9ed40409cf76cc38b760a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:25.294640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fc9b9-eba4-4396-94ad-7dcddcc295f5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:25.296337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 562/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:25 2022] GET /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:25.303294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:25.414076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe50b-1e90-44c7-80db-3dc242a65050 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:25.450925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:25.451664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:25.451945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:25.452220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:25.453044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] RBAC: Adding query filter params (role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=3eff040bc9ed40409cf76cc38b760a5a, user.id=7d040b49ca5d480396ec030d34b7450f) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:25.453354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:25.454821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c019b-34e2-41f1-86e1-8cc864990a53 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:25.460687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 555/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:25 2022] GET /identity/v3/role_assignments?user.id=7d040b49ca5d480396ec030d34b7450f&scope.project.id=3eff040bc9ed40409cf76cc38b760a5a&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:27.747185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119507-2c0e-4033-b000-3343f5a81c8d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:27.747769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119507-2c0e-4033-b000-3343f5a81c8d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:27.747769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29119507-2c0e-4033-b000-3343f5a81c8d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:27.749012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 563/1118] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:27.755105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:27.755515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:27.755639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:27.773210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:27.774497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:27.833220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:27.845788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 556/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:27.868825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29119507-2c0e-4033-b000-3343f5a81c8d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:27.970709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29119507-2c0e-4033-b000-3343f5a81c8d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:28.008665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:28.009435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:28.009720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:28.010020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] PATH_INFO: `/v3/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:28.011735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] RBAC: Authorizing `identity:get_role(role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:28.013284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:28.014835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 564/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:27 2022] GET /identity/v3/roles/625fb35ccd424520a9a0766b1d193e60 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:28.020740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:28.133082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063e42-89b1-4ab6-a656-9a7c589d37a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:28.169945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:28.170966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:28.171337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:28.171704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] PATH_INFO: `/v3/users/7d040b49ca5d480396ec030d34b7450f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:28.173014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] RBAC: Authorizing `identity:get_user(user_id=7d040b49ca5d480396ec030d34b7450f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:28.175150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:28.176815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 557/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:28 2022] GET /identity/v3/users/7d040b49ca5d480396ec030d34b7450f => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:28.186891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:28.247937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:28.299767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d9c6d-3155-4f68-aa63-d6f6ecb83b6c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:28.338082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd33e-3b1c-4b20-9300-bba32ae139cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:28.338977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd33e-3b1c-4b20-9300-bba32ae139cb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:28.339255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd33e-3b1c-4b20-9300-bba32ae139cb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:28.339530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd33e-3b1c-4b20-9300-bba32ae139cb None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:28.340746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd33e-3b1c-4b20-9300-bba32ae139cb None admin] RBAC: Authorizing `identity:get_project(project_id=3eff040bc9ed40409cf76cc38b760a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:28.342515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd33e-3b1c-4b20-9300-bba32ae139cb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:28.344286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 565/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:28 2022] GET /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:28.350942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:28.415340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:28.459932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe79db-442a-432d-9d5f-9fc0d1d2582f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:28.499129 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4be3a-9be2-41a9-a0e9-8bd9c5e0458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:28.500096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4be3a-9be2-41a9-a0e9-8bd9c5e0458d None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:28.500381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4be3a-9be2-41a9-a0e9-8bd9c5e0458d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:28.500705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4be3a-9be2-41a9-a0e9-8bd9c5e0458d None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a/users/7d040b49ca5d480396ec030d34b7450f/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:28.503194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4be3a-9be2-41a9-a0e9-8bd9c5e0458d None admin] RBAC: Authorizing `identity:create_grant(project_id=3eff040bc9ed40409cf76cc38b760a5a, user_id=7d040b49ca5d480396ec030d34b7450f, role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:28.504728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4be3a-9be2-41a9-a0e9-8bd9c5e0458d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:28.519669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 558/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:11:28 2022] PUT /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a/users/7d040b49ca5d480396ec030d34b7450f/roles/625fb35ccd424520a9a0766b1d193e60 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:11:30.820635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6aa44-71c9-4c4b-8eb4-c1a4d70c7cde None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:30.821180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6aa44-71c9-4c4b-8eb4-c1a4d70c7cde None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:30.821180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6aa44-71c9-4c4b-8eb4-c1a4d70c7cde None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:30.822741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 566/1124] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:30.828187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:30.828634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:30.828844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:30.847832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:30.849043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:30.930681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 559/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:30.956274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6aa44-71c9-4c4b-8eb4-c1a4d70c7cde None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:31.068571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6aa44-71c9-4c4b-8eb4-c1a4d70c7cde None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:31.094899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:31.106486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:31.107431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:31.107778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:31.108063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] PATH_INFO: `/v3/roles/625fb35ccd424520a9a0766b1d193e60` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:31.109716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] RBAC: Authorizing `identity:get_role(role_id=625fb35ccd424520a9a0766b1d193e60)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:31.111341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:31.113357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 567/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:30 2022] GET /identity/v3/roles/625fb35ccd424520a9a0766b1d193e60 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:31.119431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:31.171640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:31.226029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0be991-8f18-4351-9a8a-1deb2e1d987c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:31.261049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:31.261986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:31.262341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:31.262593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] PATH_INFO: `/v3/users/7d040b49ca5d480396ec030d34b7450f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:31.263843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] RBAC: Authorizing `identity:get_user(user_id=7d040b49ca5d480396ec030d34b7450f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:31.265288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:31.266977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 560/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:31 2022] GET /identity/v3/users/7d040b49ca5d480396ec030d34b7450f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:31.272815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:31.383944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41ae2d-843b-4b5e-b95a-b1726c0e7415 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:31.419976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:31.420816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:31.421108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:31.421387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:31.480635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:31.491329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:31.493155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:31.589739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 568/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:31.596489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:31.693633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dd457-91db-4e36-aaf2-02f32a03648c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:31.709622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:31.728132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d747ed8-21ca-47e3-8600-f61bf3615fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:31.728994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d747ed8-21ca-47e3-8600-f61bf3615fdf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:31.729275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d747ed8-21ca-47e3-8600-f61bf3615fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:31.729550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d747ed8-21ca-47e3-8600-f61bf3615fdf None admin] PATH_INFO: `/v3/projects/3eff040bc9ed40409cf76cc38b760a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:31.730738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d747ed8-21ca-47e3-8600-f61bf3615fdf None admin] RBAC: Authorizing `identity:get_project(project_id=3eff040bc9ed40409cf76cc38b760a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:31.732183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d747ed8-21ca-47e3-8600-f61bf3615fdf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:31.733892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 561/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:31 2022] GET /identity/v3/projects/3eff040bc9ed40409cf76cc38b760a5a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:31.740107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:31.827989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:31.837531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef49938-beeb-45cd-8b64-cfcba19d0499 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:31.871888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:31.872543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:31.872828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:31.873108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:31.873935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] RBAC: Adding query filter params (role.id=625fb35ccd424520a9a0766b1d193e60, scope.project.id=3eff040bc9ed40409cf76cc38b760a5a, user.id=7d040b49ca5d480396ec030d34b7450f) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:31.874280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:31.875726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4047d-d43e-4e69-87fa-641b2766b794 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:31.882051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 569/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:31 2022] GET /identity/v3/role_assignments?user.id=7d040b49ca5d480396ec030d34b7450f&scope.project.id=3eff040bc9ed40409cf76cc38b760a5a&role.id=625fb35ccd424520a9a0766b1d193e60 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:34.176365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064dec0-e0d7-472d-a529-41e927350c79 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:34.176917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064dec0-e0d7-472d-a529-41e927350c79 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:34.177011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064dec0-e0d7-472d-a529-41e927350c79 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:34.178477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 562/1131] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:34.184114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:34.184609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:34.184705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:34.203188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:34.204397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:34.273229 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 570/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:34.297403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064dec0-e0d7-472d-a529-41e927350c79 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:34.403934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064dec0-e0d7-472d-a529-41e927350c79 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:34.446762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848709b-94b9-4dd6-bcef-f93d5ca1df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:34.447693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848709b-94b9-4dd6-bcef-f93d5ca1df79 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:34.447973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848709b-94b9-4dd6-bcef-f93d5ca1df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:34.448248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848709b-94b9-4dd6-bcef-f93d5ca1df79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:34.449431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848709b-94b9-4dd6-bcef-f93d5ca1df79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:34.450914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848709b-94b9-4dd6-bcef-f93d5ca1df79 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:34.452562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 563/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:34.459012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:34.547539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:34.563443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bbf6d-f0f3-4bd0-b53d-4191a2bd8c87 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:34.598331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378447d-c49d-4436-b593-068ef681d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:34.598999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378447d-c49d-4436-b593-068ef681d047 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:34.599282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378447d-c49d-4436-b593-068ef681d047 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:34.599559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378447d-c49d-4436-b593-068ef681d047 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:34.600290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378447d-c49d-4436-b593-068ef681d047 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:34.601730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378447d-c49d-4436-b593-068ef681d047 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:34.628073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 571/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:11:34 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:11:36.921334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0436-43ae-413d-8874-cd223781712f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:36.922099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0436-43ae-413d-8874-cd223781712f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:36.922099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0436-43ae-413d-8874-cd223781712f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:36.923346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 564/1135] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:36.929954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:36.930490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:36.930622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:36.949363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:36.950726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:37.026835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 572/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:37.055969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0436-43ae-413d-8874-cd223781712f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:37.112317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:37.179324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0436-43ae-413d-8874-cd223781712f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:37.217501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626af50-8f18-4c65-a164-a47bef670570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:37.218329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626af50-8f18-4c65-a164-a47bef670570 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:37.218612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626af50-8f18-4c65-a164-a47bef670570 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:37.218910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626af50-8f18-4c65-a164-a47bef670570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:37.220086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626af50-8f18-4c65-a164-a47bef670570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:37.222161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626af50-8f18-4c65-a164-a47bef670570 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:37.223839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 565/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:11:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:37.229780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:37.297436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:37.332825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738ca3c-ddce-47fb-9140-fe3750c12a8e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:37.367835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46c22-54ae-4b73-b386-e80cce03e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:37.368676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46c22-54ae-4b73-b386-e80cce03e2f1 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:37.368896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46c22-54ae-4b73-b386-e80cce03e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:37.369167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46c22-54ae-4b73-b386-e80cce03e2f1 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:37.369905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e46c22-54ae-4b73-b386-e80cce03e2f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:37.371398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e46c22-54ae-4b73-b386-e80cce03e2f1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:37.392325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 573/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:11:37 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:11:39.882417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9192f-8a72-4d37-ba78-753a0ed02b18 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:39.882986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9192f-8a72-4d37-ba78-753a0ed02b18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:39.882986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9192f-8a72-4d37-ba78-753a0ed02b18 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:39.884225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 566/1139] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:39.889737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:39.890231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:39.890330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:39.907380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:39.909515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:39.979599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 574/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:40.004764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9192f-8a72-4d37-ba78-753a0ed02b18 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:40.112770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9192f-8a72-4d37-ba78-753a0ed02b18 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:40.134755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:40.149884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:40.150800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:40.151091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:40.151365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:40.167640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:40.179389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:40.180610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:40.181768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 567/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:40.186733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:40.245901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:40.296795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f28dd-22b5-40ca-b8b4-241f6460f20c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:40.332480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:40.333154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:40.333435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:40.333712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:40.334490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:40.334800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:40.336184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:40.344769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 575/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:40.350669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:40.452871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004491ab-bfcd-48da-9862-494da6d058f2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:40.488380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:40.489247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:40.489531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:40.489817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] PATH_INFO: `/v3/users/f548e6d48cc54861b2d7e44081557611` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:40.505907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] RBAC: Authorizing `identity:get_user(user_id=f548e6d48cc54861b2d7e44081557611)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:40.507408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:40.509134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 568/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:40 2022] GET /identity/v3/users/f548e6d48cc54861b2d7e44081557611 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:40.515085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:40.626606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b84ad8-7e2c-4ce7-9a11-a69276e0ce38 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:40.642723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:40.660982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:40.661637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:40.661912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:40.662217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:40.735713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:40.737671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:40.838613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 576/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:40.844786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:40.886486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:40.953772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2071-0765-4c87-91c8-857d82edd92e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:40.990925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5047f-43e1-432a-88f3-45cc53c60b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:40.991710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5047f-43e1-432a-88f3-45cc53c60b8c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:40.992072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5047f-43e1-432a-88f3-45cc53c60b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:40.992349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5047f-43e1-432a-88f3-45cc53c60b8c None admin] PATH_INFO: `/v3/projects/789f735aca9c4d8f9d8dc401407f0cce` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:40.993606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5047f-43e1-432a-88f3-45cc53c60b8c None admin] RBAC: Authorizing `identity:get_project(project_id=789f735aca9c4d8f9d8dc401407f0cce)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:40.995317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5047f-43e1-432a-88f3-45cc53c60b8c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:40.997059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 569/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:40 2022] GET /identity/v3/projects/789f735aca9c4d8f9d8dc401407f0cce => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:41.004872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:41.023446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:41.106409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2a05-e363-4f56-b54e-918b85246980 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:41.140781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:41.141432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:41.141713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:41.142012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:41.142864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=789f735aca9c4d8f9d8dc401407f0cce, user.id=f548e6d48cc54861b2d7e44081557611) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:41.143180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:41.144605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cc2a8-abd0-4f47-93d5-b3479b952642 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:41.150122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 577/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:41 2022] GET /identity/v3/role_assignments?user.id=f548e6d48cc54861b2d7e44081557611&scope.project.id=789f735aca9c4d8f9d8dc401407f0cce&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:43.359932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b74c6-2c4f-4a5e-82a9-2ccbb3edca36 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:43.360497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b74c6-2c4f-4a5e-82a9-2ccbb3edca36 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:43.360497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b74c6-2c4f-4a5e-82a9-2ccbb3edca36 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:43.362421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 570/1147] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:43.367587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:43.368038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:43.368140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:43.384409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:43.385607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:43.449096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 578/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:43.472292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b74c6-2c4f-4a5e-82a9-2ccbb3edca36 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:43.571076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b74c6-2c4f-4a5e-82a9-2ccbb3edca36 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:43.578291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:43.606722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:43.607510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:43.607799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:43.608072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:43.618222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:43.625897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:43.627045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:43.628094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 571/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:43.633123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:43.645017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:43.730052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d7949-19ac-4142-a1b0-f2363d7656d9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:43.762568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:43.763236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:43.763517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:43.763790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:43.764533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:43.764840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:43.766243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:43.775145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 579/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:43.781160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:43.881299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6f5fd-1f71-41f7-8b43-9c05ddde8422 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:43.915886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:43.916775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:43.917053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:43.917323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] PATH_INFO: `/v3/users/f548e6d48cc54861b2d7e44081557611` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:43.918510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] RBAC: Authorizing `identity:get_user(user_id=f548e6d48cc54861b2d7e44081557611)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:43.919936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:43.921555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 572/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:43 2022] GET /identity/v3/users/f548e6d48cc54861b2d7e44081557611 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:11:43.927423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:43.998907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:44.033231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39813e-6c8e-4175-a9e8-574c2966a5db None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:44.070626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6f67-10a0-45b0-99e2-e6235c30dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:44.071488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6f67-10a0-45b0-99e2-e6235c30dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:44.071766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6f67-10a0-45b0-99e2-e6235c30dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:44.072033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6f67-10a0-45b0-99e2-e6235c30dee2 None admin] PATH_INFO: `/v3/projects/789f735aca9c4d8f9d8dc401407f0cce` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:44.073192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6f67-10a0-45b0-99e2-e6235c30dee2 None admin] RBAC: Authorizing `identity:get_project(project_id=789f735aca9c4d8f9d8dc401407f0cce)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:44.074658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6f67-10a0-45b0-99e2-e6235c30dee2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:44.076327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 580/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:43 2022] GET /identity/v3/projects/789f735aca9c4d8f9d8dc401407f0cce => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:44.082864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:44.116969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:44.186534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50503942-1a64-4835-87e0-53e92bfc4f86 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:44.220032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d27825-a523-4ce6-9ea3-19d220a5ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:44.220911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27825-a523-4ce6-9ea3-19d220a5ff69 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:44.221189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27825-a523-4ce6-9ea3-19d220a5ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:44.221465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27825-a523-4ce6-9ea3-19d220a5ff69 None admin] PATH_INFO: `/v3/projects/789f735aca9c4d8f9d8dc401407f0cce/users/f548e6d48cc54861b2d7e44081557611/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:44.223414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d27825-a523-4ce6-9ea3-19d220a5ff69 None admin] RBAC: Authorizing `identity:create_grant(project_id=789f735aca9c4d8f9d8dc401407f0cce, user_id=f548e6d48cc54861b2d7e44081557611, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:44.224911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d27825-a523-4ce6-9ea3-19d220a5ff69 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:44.238614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 573/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:11:44 2022] PUT /identity/v3/projects/789f735aca9c4d8f9d8dc401407f0cce/users/f548e6d48cc54861b2d7e44081557611/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:11:46.424190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b976e8-f306-46e7-9aef-926fcae38f3c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:46.424762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b976e8-f306-46e7-9aef-926fcae38f3c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:46.424762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b976e8-f306-46e7-9aef-926fcae38f3c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:46.426202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 581/1154] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:46.431895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:46.432409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:46.432500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:46.451378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:46.452613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:46.526427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 574/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:11:46.550687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b976e8-f306-46e7-9aef-926fcae38f3c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:46.658223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b976e8-f306-46e7-9aef-926fcae38f3c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:46.694012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:46.694751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:46.695033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:46.695306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:46.703380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:46.707599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:11:46.715651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:46.717133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:11:46.718352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 582/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:46.724056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:46.749626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:46.824719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d0a1-a04c-4d83-ab6e-8e1303e53378 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:46.859193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:46.859857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:46.860139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:46.860418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:46.861279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:46.861587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:46.862995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:46.871015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 575/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:46.877356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:46.980386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed3110-b609-494f-8934-5e69c521c4b0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:47.018247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:47.019127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:47.019402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:47.019670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] PATH_INFO: `/v3/users/f548e6d48cc54861b2d7e44081557611` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:47.020848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] RBAC: Authorizing `identity:get_user(user_id=f548e6d48cc54861b2d7e44081557611)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:47.022312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:47.023945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 583/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:11:46 2022] GET /identity/v3/users/f548e6d48cc54861b2d7e44081557611 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:47.029737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:47.114764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:47.131930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e1d74-b98f-46b3-83d1-effc0190e2a7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:47.164264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:47.164898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:47.165176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:47.165447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:47.230733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:47.232114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:47.312298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:47.328265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 576/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:11:47.334292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:47.399610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:47.432146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04aff2-2177-4b48-bf7e-6ecebcbd3c0e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:47.464661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939d35-7cb9-436e-a581-259291979f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:47.465526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939d35-7cb9-436e-a581-259291979f29 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:47.465808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939d35-7cb9-436e-a581-259291979f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:47.466115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939d35-7cb9-436e-a581-259291979f29 None admin] PATH_INFO: `/v3/projects/789f735aca9c4d8f9d8dc401407f0cce` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:47.467556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e939d35-7cb9-436e-a581-259291979f29 None admin] RBAC: Authorizing `identity:get_project(project_id=789f735aca9c4d8f9d8dc401407f0cce)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:47.468989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e939d35-7cb9-436e-a581-259291979f29 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:47.470781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 584/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:11:47 2022] GET /identity/v3/projects/789f735aca9c4d8f9d8dc401407f0cce => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:47.476914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:47.576059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92498dce-f915-47ed-a945-d8cfe1ed9b01 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:47.610020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:47.610705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:47.610989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:47.611264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:47.612082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=789f735aca9c4d8f9d8dc401407f0cce, user.id=f548e6d48cc54861b2d7e44081557611) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:47.612396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:47.613842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98d7dc-30e4-41cb-b8b0-6fb040b0422e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:47.620232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 577/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:11:47 2022] GET /identity/v3/role_assignments?user.id=f548e6d48cc54861b2d7e44081557611&scope.project.id=789f735aca9c4d8f9d8dc401407f0cce&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:49.875072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2870c60-e4b5-4c1b-b9ef-29352e8c69b2 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:49.875583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2870c60-e4b5-4c1b-b9ef-29352e8c69b2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:49.875583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2870c60-e4b5-4c1b-b9ef-29352e8c69b2 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:49.877442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 585/1162] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:11:49.882829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:49.883288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:49.883390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:49.902978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:49.904203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:49.956288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:49.980004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 578/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:50.006442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2870c60-e4b5-4c1b-b9ef-29352e8c69b2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:50.121027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2870c60-e4b5-4c1b-b9ef-29352e8c69b2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:50.157907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:50.158529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:50.158815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:50.159091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:50.163094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:50.230590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:50.232089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:50.338979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 586/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:11:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:11:50.345576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:50.453472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d88b2-fea4-484b-99cf-e5c97d9c2902 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:50.487710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:50.488523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:50.488803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:50.489079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:50.496388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:50.497836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-61a4e994-ec70-4f63-bb01-54831422bb5b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:11:50.512761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:11:50.514144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:11:50.515288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 579/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:11:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:11:50.520550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:50.554751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:50.620290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578f99-7a9f-4178-99e4-aa3061705d1f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:50.657026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:50.657736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:50.658047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:50.658327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:50.659044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:11:50.659352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:50.660733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2626-8cb8-4b4f-9d4c-d03b5cae7b6e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:50.668090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 587/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Fri May 27 03:11:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:52.889463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90717c-63ab-48be-bebe-fd20a1ff714a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:52.890031 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90717c-63ab-48be-bebe-fd20a1ff714a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:52.890031 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90717c-63ab-48be-bebe-fd20a1ff714a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:52.891349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 580/1167] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:52.897179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13670944-61b0-49ab-a811-b4c935f455e5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:52.897626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13670944-61b0-49ab-a811-b4c935f455e5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:52.897720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13670944-61b0-49ab-a811-b4c935f455e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:52.915150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-13670944-61b0-49ab-a811-b4c935f455e5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:52.916335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-13670944-61b0-49ab-a811-b4c935f455e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:52.989571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 588/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:53.012681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90717c-63ab-48be-bebe-fd20a1ff714a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:53.059380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:53.123181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90717c-63ab-48be-bebe-fd20a1ff714a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:53.158280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438d0e3-a702-4415-84b4-b8bd0ca02abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:53.158847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438d0e3-a702-4415-84b4-b8bd0ca02abe None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:53.159125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438d0e3-a702-4415-84b4-b8bd0ca02abe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:53.159395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438d0e3-a702-4415-84b4-b8bd0ca02abe None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:53.160132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438d0e3-a702-4415-84b4-b8bd0ca02abe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:53.161506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438d0e3-a702-4415-84b4-b8bd0ca02abe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:53.177037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 581/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Fri May 27 03:11:53 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:55.416873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58abf4a-3840-4bf0-84e7-8655c4329f03 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:55.417596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58abf4a-3840-4bf0-84e7-8655c4329f03 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:55.417596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58abf4a-3840-4bf0-84e7-8655c4329f03 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:55.418878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 589/1170] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:55.424725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:55.425201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:55.425325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:55.442558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:55.443748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:55.518867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 582/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:55.551563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58abf4a-3840-4bf0-84e7-8655c4329f03 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:55.583267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:55.666014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58abf4a-3840-4bf0-84e7-8655c4329f03 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:55.699710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329274-c483-4f45-834b-4b43c5fe2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:55.700493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329274-c483-4f45-834b-4b43c5fe2bcd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:55.700776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329274-c483-4f45-834b-4b43c5fe2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:55.701084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329274-c483-4f45-834b-4b43c5fe2bcd None admin] PATH_INFO: `/v3/domains/451ee81fd89749948487b4a94bcd2189` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:55.712083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329274-c483-4f45-834b-4b43c5fe2bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=451ee81fd89749948487b4a94bcd2189)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:55.713536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329274-c483-4f45-834b-4b43c5fe2bcd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:55.715274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 590/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Fri May 27 03:11:55 2022] GET /identity/v3/domains/451ee81fd89749948487b4a94bcd2189 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:55.721832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:55.750563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:55.820219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a363d71-4ae8-45af-9105-c57c870f1566 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:55.854224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2750-ab6a-4e83-bb16-303e8e5b247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:55.854881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2750-ab6a-4e83-bb16-303e8e5b247c None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:55.855165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2750-ab6a-4e83-bb16-303e8e5b247c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:55.855440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2750-ab6a-4e83-bb16-303e8e5b247c None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:55.856150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2750-ab6a-4e83-bb16-303e8e5b247c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:55.857577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2750-ab6a-4e83-bb16-303e8e5b247c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:55.883801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 583/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:11:55 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:11:58.130102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07135-eceb-461e-936b-fb358f44c227 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:58.130722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07135-eceb-461e-936b-fb358f44c227 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:58.130722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07135-eceb-461e-936b-fb358f44c227 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:58.132066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 591/1174] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:11:58.137516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:58.137984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:58.138082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:58.154894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:11:58.156077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:11:58.229892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 584/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:11:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:11:58.255703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07135-eceb-461e-936b-fb358f44c227 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:58.348552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:58.359945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07135-eceb-461e-936b-fb358f44c227 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:58.395913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7c6c-7f00-43d6-b593-8b642f2f0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:58.396694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7c6c-7f00-43d6-b593-8b642f2f0e60 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:58.396975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7c6c-7f00-43d6-b593-8b642f2f0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:58.397246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7c6c-7f00-43d6-b593-8b642f2f0e60 None admin] PATH_INFO: `/v3/domains/451ee81fd89749948487b4a94bcd2189` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:58.398448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f7c6c-7f00-43d6-b593-8b642f2f0e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=451ee81fd89749948487b4a94bcd2189)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:58.399889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f7c6c-7f00-43d6-b593-8b642f2f0e60 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:58.401515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 592/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Fri May 27 03:11:58 2022] GET /identity/v3/domains/451ee81fd89749948487b4a94bcd2189 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:11:58.407394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:11:58.421356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:11:58.511104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fd105-a3d0-49f6-a21e-90b473c65da3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:11:58.544844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f04e-a0fe-4cdc-a05c-d87bc55aa9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:11:58.545508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f04e-a0fe-4cdc-a05c-d87bc55aa9cf None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:11:58.545791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f04e-a0fe-4cdc-a05c-d87bc55aa9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:11:58.546096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f04e-a0fe-4cdc-a05c-d87bc55aa9cf None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:11:58.546813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f04e-a0fe-4cdc-a05c-d87bc55aa9cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:11:58.548824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f04e-a0fe-4cdc-a05c-d87bc55aa9cf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:11:58.569313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 585/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:11:58 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:12:00.843924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d6664-533a-4e36-94ba-fd5a3b3dfd6a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:00.844489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d6664-533a-4e36-94ba-fd5a3b3dfd6a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:00.844489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d6664-533a-4e36-94ba-fd5a3b3dfd6a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:00.845847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 593/1178] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:12:00.851755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:00.852172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:00.852306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:00.868734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:12:00.869918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:12:00.930667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:00.937007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 586/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:12:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:12:00.960670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d6664-533a-4e36-94ba-fd5a3b3dfd6a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:01.066633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d6664-533a-4e36-94ba-fd5a3b3dfd6a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:01.100912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:01.101630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:01.101913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:01.102230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:01.112690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:12:01.120352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:12:01.121502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:12:01.122528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 594/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:12:01.128788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:01.226767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb3d20-607a-4c96-9e68-76d967359064 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:01.259872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:01.260531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:01.260811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:01.261084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:01.261823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:12:01.262147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:01.263522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:01.271892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 587/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:01.277710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:01.299916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:01.380487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23fc0-e593-4a32-8996-3358e847629a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:01.413272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:01.414172 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:01.414454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:01.414729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] PATH_INFO: `/v3/users/132958e658cb4aaeaf2630228be77564` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:01.428267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] RBAC: Authorizing `identity:get_user(user_id=132958e658cb4aaeaf2630228be77564)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:01.429720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:01.431416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 595/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:12:01 2022] GET /identity/v3/users/132958e658cb4aaeaf2630228be77564 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:01.437111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:01.495853 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:01.537402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bef76-0d6f-4469-9613-2b663c4b24be None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:01.572236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:01.572888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:01.573173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:01.573449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:01.639323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:01.640699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:01.695964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:01.739131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 588/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:12:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:12:01.745828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:01.820401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:01.843604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcc008-0f1b-497c-96b0-b91346d7b0e6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:01.876718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f82bc-acaf-4092-be65-dcb37a4a8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:01.877685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f82bc-acaf-4092-be65-dcb37a4a8be2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:01.877993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f82bc-acaf-4092-be65-dcb37a4a8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:01.878272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f82bc-acaf-4092-be65-dcb37a4a8be2 None admin] PATH_INFO: `/v3/projects/14a09c61b97b482289cebdfde173134d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:01.879437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f82bc-acaf-4092-be65-dcb37a4a8be2 None admin] RBAC: Authorizing `identity:get_project(project_id=14a09c61b97b482289cebdfde173134d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:01.880873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f82bc-acaf-4092-be65-dcb37a4a8be2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:01.882570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 596/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:12:01 2022] GET /identity/v3/projects/14a09c61b97b482289cebdfde173134d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:01.888606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:01.985849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c87be-ea21-4dbd-8ae6-e680d6604e5f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:02.019723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:02.020370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:02.020654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:02.020930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:02.021750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=14a09c61b97b482289cebdfde173134d, user.id=132958e658cb4aaeaf2630228be77564) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:12:02.022090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:02.023532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70580b1d-050f-423b-8ca7-62f907f28777 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:02.028920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 589/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:12:01 2022] GET /identity/v3/role_assignments?user.id=132958e658cb4aaeaf2630228be77564&scope.project.id=14a09c61b97b482289cebdfde173134d&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:04.184607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64cfc-e86a-4019-a4de-6e025268edd1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:04.185178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64cfc-e86a-4019-a4de-6e025268edd1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:04.185178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64cfc-e86a-4019-a4de-6e025268edd1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:04.186578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 597/1186] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:12:04.192509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:04.193044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:04.193044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:04.211328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:12:04.212530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:12:04.233492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:04.284488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 590/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:12:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:12:04.307980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a64cfc-e86a-4019-a4de-6e025268edd1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:04.419305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a64cfc-e86a-4019-a4de-6e025268edd1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:04.458345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:04.459146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:04.459426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:04.459699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:04.470037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:12:04.477622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:12:04.478776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:12:04.479854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 598/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:12:04.485395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:04.583050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6134f8-9fcd-4fe0-8572-cf02350ff577 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:04.616270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:04.616927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:04.617204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:04.617475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:04.618227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:12:04.618532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:04.619889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:04.627683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 591/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:04.633699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:04.637395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:04.736427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa56c5-2df6-4248-90c3-59479864d013 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:04.775474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:04.776348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:04.776638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:04.776916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] PATH_INFO: `/v3/users/132958e658cb4aaeaf2630228be77564` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:04.778137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=132958e658cb4aaeaf2630228be77564)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:04.779585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:04.781250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 599/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:12:04 2022] GET /identity/v3/users/132958e658cb4aaeaf2630228be77564 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:04.787572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:04.806458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:04.890083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a01f9-d9c1-4247-a3be-35a6ce79841b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:04.922871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f44e69-18d8-4976-8288-42d85be2021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:04.923721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44e69-18d8-4976-8288-42d85be2021f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:04.924003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44e69-18d8-4976-8288-42d85be2021f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:04.924276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44e69-18d8-4976-8288-42d85be2021f None admin] PATH_INFO: `/v3/projects/14a09c61b97b482289cebdfde173134d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:04.925440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f44e69-18d8-4976-8288-42d85be2021f None admin] RBAC: Authorizing `identity:get_project(project_id=14a09c61b97b482289cebdfde173134d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:04.926900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f44e69-18d8-4976-8288-42d85be2021f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:04.928595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 592/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:12:04 2022] GET /identity/v3/projects/14a09c61b97b482289cebdfde173134d => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:04.934852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:05.009940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:05.041874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823a533-4a1c-4119-a5f9-d1015e5b1ab3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:05.081323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e4191-344e-4ed9-a95f-870fee3dfa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:05.082247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e4191-344e-4ed9-a95f-870fee3dfa3a None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:05.082528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e4191-344e-4ed9-a95f-870fee3dfa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:05.082806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e4191-344e-4ed9-a95f-870fee3dfa3a None admin] PATH_INFO: `/v3/projects/14a09c61b97b482289cebdfde173134d/users/132958e658cb4aaeaf2630228be77564/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:05.084796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e4191-344e-4ed9-a95f-870fee3dfa3a None admin] RBAC: Authorizing `identity:create_grant(project_id=14a09c61b97b482289cebdfde173134d, user_id=132958e658cb4aaeaf2630228be77564, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:05.086267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e4191-344e-4ed9-a95f-870fee3dfa3a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:05.099300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 600/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:12:04 2022] PUT /identity/v3/projects/14a09c61b97b482289cebdfde173134d/users/132958e658cb4aaeaf2630228be77564/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:12:07.327115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964dbe3-f1c7-4be2-8e5c-33448a89ae86 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:07.327695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964dbe3-f1c7-4be2-8e5c-33448a89ae86 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:07.327695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964dbe3-f1c7-4be2-8e5c-33448a89ae86 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:07.329099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 593/1193] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:12:07.336097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:07.336583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:07.336707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:07.354305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:12:07.355516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:12:07.424647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 601/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:12:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:12:07.447894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964dbe3-f1c7-4be2-8e5c-33448a89ae86 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:07.535035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:07.552005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964dbe3-f1c7-4be2-8e5c-33448a89ae86 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:07.585678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:07.586531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:07.586817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:07.587090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:07.598490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:12:07.606176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:12:07.607298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:12:07.608193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 594/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:12:07.613433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:07.677223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:07.718090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16677712-e2c5-4b7c-8b47-d55f9cccbae7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:07.751774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:07.752439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:07.752722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:07.752998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:07.753737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:12:07.754073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:07.755446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:07.763480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 602/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:12:07.769931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:07.870338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ac52b-a9eb-4a76-86bf-d7e545a7c31c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:07.904060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:07.904922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:07.905205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:07.905482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] PATH_INFO: `/v3/users/132958e658cb4aaeaf2630228be77564` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:07.907268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] RBAC: Authorizing `identity:get_user(user_id=132958e658cb4aaeaf2630228be77564)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:07.908766 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:07.910458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 595/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Fri May 27 03:12:07 2022] GET /identity/v3/users/132958e658cb4aaeaf2630228be77564 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:07.916161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:08.021141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590394b3-4299-4d03-a8da-620b321ba7d9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:08.051448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:08.064357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:08.065007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:08.065287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:08.065589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:08.131036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:08.132388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:08.225685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 603/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:12:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:12:08.231589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:08.246822 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:08.329297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3d53-feb0-494d-b386-bdc4ffbdf760 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:08.363229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7622-deab-4556-ade7-b2e2733df3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:08.364077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7622-deab-4556-ade7-b2e2733df3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:08.364355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7622-deab-4556-ade7-b2e2733df3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:08.364626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7622-deab-4556-ade7-b2e2733df3f7 None admin] PATH_INFO: `/v3/projects/14a09c61b97b482289cebdfde173134d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:08.365798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b7622-deab-4556-ade7-b2e2733df3f7 None admin] RBAC: Authorizing `identity:get_project(project_id=14a09c61b97b482289cebdfde173134d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:08.367262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b7622-deab-4556-ade7-b2e2733df3f7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:08.368941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 596/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Fri May 27 03:12:08 2022] GET /identity/v3/projects/14a09c61b97b482289cebdfde173134d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:08.375300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:12:08.400189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:08.474391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d34ab-74eb-44cc-9e48-cf5b1ac339be None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:12:08.506798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:12:08.507462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:12:08.507747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:12:08.508025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:12:08.508851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=14a09c61b97b482289cebdfde173134d, user.id=132958e658cb4aaeaf2630228be77564) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:12:08.509167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:12:08.510659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c9b4-ad8c-450e-9f4d-b891347c96e7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:12:08.517186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 604/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:12:08 2022] GET /identity/v3/role_assignments?user.id=132958e658cb4aaeaf2630228be77564&scope.project.id=14a09c61b97b482289cebdfde173134d&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:12:18.359709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=60 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:12:18.514310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=56 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:10.945110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d6cb2-4ba9-40eb-b130-51bdae0d65fd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:10.945722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d6cb2-4ba9-40eb-b130-51bdae0d65fd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:10.945722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d6cb2-4ba9-40eb-b130-51bdae0d65fd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:10.947122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 597/1201] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:10.954941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:10.955558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:10.955558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:10.981357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:10.983242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:11.074009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 605/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:11.098435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d6cb2-4ba9-40eb-b130-51bdae0d65fd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:11.267651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d6cb2-4ba9-40eb-b130-51bdae0d65fd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:11.314023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:11.315133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:11.315406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:11.315661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:11.328412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:11.330197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:11.359558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:11.360731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:11.361784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:11.361784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:11.361784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:11.361784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:11.361784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 598/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:11.368126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:11.539866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cb117-1538-4256-8b3c-a07d45bcf5b3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:11.585851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:11.594586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:11.595360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:11.595723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:11.596285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:11.597027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:11.597337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:11.598783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b518f2a-c03c-4a2e-aa82-4d9515468684 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:11.622272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 606/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:11.625876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:11.710032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:11.798235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7582-c43c-47c8-8936-062829fb56da None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:11.858108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95380e-32b7-4383-a9f0-46b11d0f172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:11.859065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95380e-32b7-4383-a9f0-46b11d0f172d None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:11.859363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95380e-32b7-4383-a9f0-46b11d0f172d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:11.859636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95380e-32b7-4383-a9f0-46b11d0f172d None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:11.860616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95380e-32b7-4383-a9f0-46b11d0f172d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:11.862647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95380e-32b7-4383-a9f0-46b11d0f172d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:11.904911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 599/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Fri May 27 03:13:11 2022] POST /identity/v3/users => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:13:14.406439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2974-a6ad-46af-9e38-427ebc001d71 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:14.407157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2974-a6ad-46af-9e38-427ebc001d71 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:14.407157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2974-a6ad-46af-9e38-427ebc001d71 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:14.408456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 607/1206] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:14.414044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:14.414591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:14.414591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:14.433956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:14.435210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:14.514239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 600/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:14.539171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2974-a6ad-46af-9e38-427ebc001d71 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:14.674870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2974-a6ad-46af-9e38-427ebc001d71 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:14.715677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:14.716443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:14.716757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:14.716993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:14.730084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:13:14.738578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:14.741482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:14.742663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 608/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:13:14.746418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:14.793085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:14.880002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c063ada-98b0-4fad-b9cb-6d8f51594a9d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:14.930881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:14.930881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:14.930881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:14.930881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:14.932001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:14.932534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:14.934727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:14.949385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 601/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:14.955141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:15.023551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:15.108980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204a23-5a22-4360-aa77-4669663eccd3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:15.150050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:15.150948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:15.151219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:15.151526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:15.172379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:15.173876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:15.209596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:15.210830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:15.212329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:15.212329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:15.212329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:15.212329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:15.212329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 609/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:15.217345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:15.356024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:15.360516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfecaf5-ebf3-417e-bfc2-03ca301540ff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:15.408160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:15.408874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:15.409188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:15.409524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:15.410253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:15.410593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:15.412212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:15.427916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 602/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:15.434052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:15.559060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e071f-e524-4900-95e1-8f1ffaa35a5e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:15.560951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:15.609289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:15.610392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:15.610698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:15.611041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:15.621312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:15.622831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:13:15.640214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:15.643278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:15.644543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 610/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:15.647452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:15.816366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5c60-1750-48c4-8829-c4a0d3b54b44 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:15.876917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:15.878094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:15.878675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:15.879159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:15.880934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:15.881445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:15.884329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:15.925666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 603/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Fri May 27 03:13:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:15.927336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:16.075207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96f7ac-b7bf-4e73-a2b8-2b2576b21710 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:16.115220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:16.115902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:16.116203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:16.116552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:16.160285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:16.222742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:16.224488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:16.354873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 611/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:13:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:13:16.362791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:16.384238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:16.501711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ff72-d5b8-400f-82fd-7cb573749d0e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:16.550775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:16.550775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:16.550775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:16.550775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:16.563057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:16.564559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:16.585848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:16.593347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:16.594647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:16.594647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:16.594647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:16.594647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:16.594647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 604/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:16.596067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:16.678931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:16.737302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552ef4-bd7e-489b-84dd-4bc5983ea046 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:16.791249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:16.791936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:16.791936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:16.791936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:16.791936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:16.791936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:16.796594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:16.820639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 612/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:16.827246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:16.923629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:16.959429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208d58-37c4-447f-b588-bba0e8d07ee3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:17.006074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:17.007309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:17.007789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:17.008382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:17.018016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:17.019584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:13:17.042867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:17.051944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:17.053718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 605/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:13:17.057203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:17.200269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bbed6-7c81-4a70-8b85-1315cbd8b4b3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:17.237698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:17.253863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:17.254856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:17.255309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:17.255583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:17.256377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:17.256683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:17.258213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15bf1e-a017-481c-b9f9-f675c2fbfb16 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:17.274993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 613/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:17.282337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:17.405182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7c32-1ad1-4160-b672-6a942dc02333 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:17.460433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:17.468604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:17.469803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:17.470127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:17.470402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:17.471267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=f2e7c7b4f94b4830adc49cf2f4b84d94) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:17.471561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:17.473149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1473e-e2a1-4916-8d1f-757bc6e6745f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:17.486014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 606/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:13:17 2022] GET /identity/v3/role_assignments?user.id=f2e7c7b4f94b4830adc49cf2f4b84d94&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:19.786570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65f08-eec9-48dd-882d-51425bc67543 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:19.787347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65f08-eec9-48dd-882d-51425bc67543 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:19.787347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65f08-eec9-48dd-882d-51425bc67543 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:19.788416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 614/1220] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:19.797088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:19.797781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:19.797781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:19.822037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:19.823969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:19.903899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 607/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:19.927173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65f08-eec9-48dd-882d-51425bc67543 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:20.036791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65f08-eec9-48dd-882d-51425bc67543 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:20.075462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:20.076354 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:20.076693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:20.077027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:20.091129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:13:20.099173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:20.101495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:13:20.103319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:20.106559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 615/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:13:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:20.107714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:20.235347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3359-8fd7-4cd9-92a8-1ed73dc24e8f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:20.278122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:20.298845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:20.299865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:20.300382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:20.300852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:20.302247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:20.302769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:20.305440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:20.326874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 608/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:20.328910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:20.396653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:20.494847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce68e09-eea0-4770-b239-4a26060b4b4f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:20.534690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:20.535497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:20.535776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:20.536047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:20.550002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:20.551715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:20.585046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:20.587351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:20.596612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:20.596612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:20.596612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:20.596612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:20.596612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 616/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:13:20.597259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:20.754219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56027cb-233f-430f-842b-017c18eeef27 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:20.819728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:20.820797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:20.821163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:20.821574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:20.822681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:20.823113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:20.825122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:20.842541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 609/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:20.851592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:20.989495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:20.998249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904e47e-c19b-4f2a-a714-405d238169d0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:21.044269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:21.045170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:21.045591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:21.046022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:21.056150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:21.057729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:13:21.075341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:21.077598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:21.079565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 617/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:21.084516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:21.142391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:21.235173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1768b-c286-4f9d-9b56-aeb020fd4467 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:21.296499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:21.297672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:21.298212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:21.298704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:21.300325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:21.300849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:21.303734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:21.343247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 610/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Fri May 27 03:13:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:21.345027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:21.488774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48daea0-f4c0-414c-b6d3-a0049452b721 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:21.544039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:21.545522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:21.546132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:21.546606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:21.567189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:21.569573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:21.599719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:21.600791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:21.607688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:21.607688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:21.607688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:21.607688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:21.607688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 618/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:21.608239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:21.747986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1e93-b342-4079-9e6f-9c0e889b92c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:21.751121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:21.794620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:21.795304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:21.795583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:21.795854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:21.796579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:21.796883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:21.798309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:21.815560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 611/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:21.823355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:21.836649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:21.977550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3699266-d8b6-4279-8a73-cb98c525b4e1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:22.025378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:22.027158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:22.027517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:22.027678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:22.035907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:22.037379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:13:22.053043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:22.054216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:22.055689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 619/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:22.063301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:22.195163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73140486-45c3-42b7-8293-d9839aa4705d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:22.251570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:22.252459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:22.253200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:22.253598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:22.255309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:22.255940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:22.258629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdca38a-df2b-4fa0-bf09-858eb8f53f6d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:22.286319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 612/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:22.288736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:22.389939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:22.451099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5254c79-9228-410b-a08c-a9ab566b69aa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:22.516885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab800aa-bc3c-4bb3-86c5-71165c39815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:22.517939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab800aa-bc3c-4bb3-86c5-71165c39815d None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:22.518439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab800aa-bc3c-4bb3-86c5-71165c39815d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:22.518915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab800aa-bc3c-4bb3-86c5-71165c39815d None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/f2e7c7b4f94b4830adc49cf2f4b84d94/roles/e9bc7f32be2e4634a912e897ae1b8fc5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:22.542147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab800aa-bc3c-4bb3-86c5-71165c39815d None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=f2e7c7b4f94b4830adc49cf2f4b84d94, role_id=e9bc7f32be2e4634a912e897ae1b8fc5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:22.544734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab800aa-bc3c-4bb3-86c5-71165c39815d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:22.563528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 620/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:13:22 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/f2e7c7b4f94b4830adc49cf2f4b84d94/roles/e9bc7f32be2e4634a912e897ae1b8fc5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:13:25.129326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dc149-db58-4033-90cb-5d417cf131f3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:25.130016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dc149-db58-4033-90cb-5d417cf131f3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:25.130016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dc149-db58-4033-90cb-5d417cf131f3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:25.131629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 613/1233] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:25.140069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:25.140647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:25.141023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:25.162270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:25.164210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:25.267251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 621/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:25.306078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dc149-db58-4033-90cb-5d417cf131f3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:25.353898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:25.483403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dc149-db58-4033-90cb-5d417cf131f3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:25.542782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:25.543954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:25.544411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:25.544759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:25.558013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:13:25.568155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:25.569362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:25.570924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 614/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Fri May 27 03:13:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:13:25.576202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:25.646650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:25.732002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac61a35-fc94-48ea-b8cf-73fc6bcdc18e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:25.781119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:25.781754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:25.782094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:25.782329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:25.783104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:25.783412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:25.784947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:25.802620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 622/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Fri May 27 03:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:25.804489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:25.950982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:25.975659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9b6ef-8c95-4e37-aeb6-a28e23aa4746 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:26.034470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:26.035607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:26.036189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:26.036660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:26.064025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:26.067779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:26.103587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:26.106187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:26.108083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:26.108083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:26.108083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:26.108083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:26.108083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 615/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:26.112955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:26.275892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6130ed8-aaba-4f50-ab71-e36cc40d619b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:26.295041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:26.340713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:26.341843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:26.342385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:26.342869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:26.344205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:26.344765 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:26.347362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:26.368982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 623/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:26.377060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:26.518976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a1ef-0571-4e1c-a31a-ff1136b811a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:26.573669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:26.574540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:26.574863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:26.575121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:26.580448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:26.587026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:26.589721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:13:26.608521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:26.609936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:26.611162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 616/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:26.617256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:26.764197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f31d-a8e3-4a2e-a0f5-d74812b919d4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:26.806922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:26.808149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:26.808468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:26.808758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:26.809680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:26.810027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:26.811610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:26.833914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 624/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Fri May 27 03:13:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:26.840301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:26.961277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b6dc0-b28b-41d3-86b7-82f31efb1397 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:27.019180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:27.020407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:27.020920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:27.021425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:27.118942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:27.131187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:27.133349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:27.264058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 617/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:13:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:13:27.273559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:27.314867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:27.403303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da8c7f-e0d4-49c2-9260-4674edd6901e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:27.450041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:27.451064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:27.451406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:27.451777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:27.465596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:27.467337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:27.489052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:27.491214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:27.493457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:27.493457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:27.493457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:27.493457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:27.494900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 625/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:27.498436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:27.633882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:27.642522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17759f9-5e8c-474b-99b1-83ba7446f82e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:27.696953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:27.697605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:27.698515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:27.698845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:27.699608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:27.699957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:27.701403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:27.713724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 618/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:27.722992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:27.855884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:27.886314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45edd1-7490-4c25-9116-9a8929037c4b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:27.935509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:27.936524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:27.936910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:27.937287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:27.944813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:27.946451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:13:27.960981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:27.962245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:27.963290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 626/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:27.968679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:28.089291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231c6dd-9df3-4791-a42c-b0fb4d13df32 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:28.131045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:28.131912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:28.132196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:28.132471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:28.133252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:28.133561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:28.135044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f6fb8-0eb6-4935-bea6-f1a046e2b223 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:28.149908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 619/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:28.157365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:28.286230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78f9e3-dc74-4d10-87a7-d9688a38d74c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:28.330941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:28.331665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:28.331929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:28.332171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:28.333273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] RBAC: Adding query filter params (role.id=e9bc7f32be2e4634a912e897ae1b8fc5, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=f2e7c7b4f94b4830adc49cf2f4b84d94) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:28.333589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:28.335140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7c2f7-f507-4fec-8ec2-8b94d341c798 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:28.343702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 627/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:13:28 2022] GET /identity/v3/role_assignments?user.id=f2e7c7b4f94b4830adc49cf2f4b84d94&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=e9bc7f32be2e4634a912e897ae1b8fc5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:30.763374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac3ba-6e14-4de8-a171-37bdd992f539 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:30.763996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac3ba-6e14-4de8-a171-37bdd992f539 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:30.763996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac3ba-6e14-4de8-a171-37bdd992f539 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:30.765244 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 620/1247] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:30.771371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:30.771846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:30.772000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:30.777672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:30.790058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:30.791809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:30.866138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 628/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:13:30.891576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac3ba-6e14-4de8-a171-37bdd992f539 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:30.914519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:31.018047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faac3ba-6e14-4de8-a171-37bdd992f539 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:31.067087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:31.067890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:31.068180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:31.068461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:31.082296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:13:31.091338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:31.093227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:31.095896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 621/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:31.101050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:31.241564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76ccf6-4348-4a0f-9756-0c0dc6b102d3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:31.282671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:31.288441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:31.289228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:31.289585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:31.289967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:31.290893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:31.291258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:31.293350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:31.304012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 629/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:31.311307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:31.413531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:31.440432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cc059-790f-427b-99a0-ad542efbc0bd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:31.480424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:31.481217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:31.481500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:31.481774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:31.497505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:31.499117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:31.518412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:31.519597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:31.521024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:31.521024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:31.521024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:31.521024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:31.521024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 622/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:31.525682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:31.653709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55883-2161-4720-adee-201e815e35e4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:31.694633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:31.695307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:31.695590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:31.695877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:31.696578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:31.696885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:31.698921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:31.713169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 630/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:31.720218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:31.828956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af944d-c1bb-491f-b0d2-62395819fca4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:31.859167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:31.868115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:31.868941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:31.869223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:31.870135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:31.878983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:31.880520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:13:31.896759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:31.898122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:31.899376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 623/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:31.905148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:31.965947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:32.018623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce006771-93cb-40a3-a234-86c844f008c1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:32.067634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:32.068676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:32.069164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:32.069862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:32.071612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:32.072225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:32.075393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:32.106460 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 631/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Fri May 27 03:13:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:32.107984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:32.230367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c857-acab-4b14-bdc0-e0d622e2439a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:32.282223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:32.283038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:32.283393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:32.283746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:32.345358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:32.364065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:32.365758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:32.485642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 624/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:13:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:13:32.487614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:32.604496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21127f9-bc69-434b-a0cf-9cc5b0da98f6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:32.619341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:32.643126 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:32.643931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:32.644205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:32.644506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:32.656611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:32.658353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:32.682471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:32.684358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:32.685730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:32.685730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:32.685730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:32.685730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:32.685730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 632/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:32.691746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:32.797845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:32.815300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51993c9-3e1f-45a4-a176-dfbd88d3deae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:32.853441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:32.854772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:32.854989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:32.855264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:32.855978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:32.856285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:32.857674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:32.870565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 625/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:32.876420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:33.001211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e43f-44f0-4fc7-ac11-0602b0910f8e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:33.045280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:33.046163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:33.046446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:33.046721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:33.054977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:33.056465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:13:33.071966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:33.073749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:33.074903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 633/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:13:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:33.080298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:33.193425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae22c-c857-486d-9d9c-3b2e6a1c9def None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:33.242137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:33.242831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:33.243113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:33.243389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:33.244183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:33.244598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:33.246794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e7b84-a85c-4071-848e-a67e2036d0b3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:33.264588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 626/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:33.270928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:33.301240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:33.383358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298aa01-316b-421f-be88-30b4e4f419ce None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:33.419064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:33.419735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:33.420019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:33.420296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:33.421144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=f2e7c7b4f94b4830adc49cf2f4b84d94) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:33.421454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:33.422970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae858858-cfd9-4939-9fec-033f3599a57a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:33.429265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 634/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:13:33 2022] GET /identity/v3/role_assignments?user.id=f2e7c7b4f94b4830adc49cf2f4b84d94&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=d0122fde930842079d42ce76139767e2 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:13:35.633218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991c22-03fc-4b7f-b2ad-b0e246a58e58 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:35.633786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991c22-03fc-4b7f-b2ad-b0e246a58e58 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:35.633786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991c22-03fc-4b7f-b2ad-b0e246a58e58 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:35.635840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 627/1261] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:35.641396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:35.641871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:35.642008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:35.658625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:35.659809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:35.725484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 635/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:35.748492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991c22-03fc-4b7f-b2ad-b0e246a58e58 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:35.759436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:35.851165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991c22-03fc-4b7f-b2ad-b0e246a58e58 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:35.884131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:35.885517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:35.885793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:35.886094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:35.895968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:13:35.903683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:35.904816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:35.906039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 628/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:35.910792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:35.928702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:36.009180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14942-e6dc-4021-b2ad-c33a69c2d05f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:36.043247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:36.043913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:36.044196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:36.044473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:36.045211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:36.045520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:36.046928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:36.054975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 636/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:36.061514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:36.128908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:36.161681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435ec51-1b21-4081-8154-892be00425c1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:36.195211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:36.196006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:36.196287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:36.196560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:36.207422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:36.208856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:36.226867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:36.229026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:36.230838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:36.230838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:36.230838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:36.230838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:36.230838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 629/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:36.234569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:36.321822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:36.341024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b38055-0c11-4f65-927e-afd72308ee67 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:36.374699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:36.375368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:36.375655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:36.375928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:36.376647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:36.376954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:36.378356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:36.390071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 637/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:36.396060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:36.497520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ae679-f81f-4ac4-9603-94a34a4db9cc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:36.517393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:36.532167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:36.532971 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:36.533249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:36.533520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:36.541683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:36.543164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:13:36.557323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:36.558667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:36.560027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 630/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:36.564676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:36.671127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c43e-4f2b-49e3-b745-a719190b3082 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:36.704444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:36.705107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:36.705390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:36.705665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:36.706522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:36.706833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:36.708286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:36.717019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:36.725924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 638/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Fri May 27 03:13:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:36.732097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:36.830870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6a8e-70de-4f4c-a27d-95ad3826a3a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:36.864302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:36.865098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:36.865384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:36.865673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:36.877591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:36.879078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:36.895788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:36.896870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:36.898216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:36.898216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:36.898216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:36.898216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:36.898216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 631/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:36.902754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:37.002310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e7eec-7268-441a-b61d-0a902f5163f6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:37.035658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:37.036324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:37.036610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:37.036882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:37.037601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:37.037910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:37.039322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:37.051113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 639/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:37.057399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:37.088741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:37.158049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa392d54-762f-4431-8365-fc72a3718cad None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:37.191123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:37.191906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:37.192188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:37.192463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:37.199111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:37.200563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:13:37.216181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:37.217419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:37.223417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 632/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:37.224146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:37.285429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:37.327198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d273e2d-9e18-4325-92a4-1c86720c6829 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:37.360892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:37.361553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:37.361836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:37.362142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:37.362922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:37.363233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:37.364679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fc2b3-6b66-49ed-913e-b788427507c2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:37.376591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 640/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:37.382542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:37.479263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:37.492676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c651ef-fb7f-4e8b-89cb-ba6b686f2616 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:37.526937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f9592-146c-4f39-ae17-2980e9a3ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:37.527810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9592-146c-4f39-ae17-2980e9a3ed28 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:37.528085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9592-146c-4f39-ae17-2980e9a3ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:37.528353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9592-146c-4f39-ae17-2980e9a3ed28 None admin] PATH_INFO: `/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/f2e7c7b4f94b4830adc49cf2f4b84d94/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:37.530286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f9592-146c-4f39-ae17-2980e9a3ed28 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1429c6830842569ae0b2cd48e3d563, user_id=f2e7c7b4f94b4830adc49cf2f4b84d94, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:37.531703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f9592-146c-4f39-ae17-2980e9a3ed28 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:37.544324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 633/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Fri May 27 03:13:37 2022] PUT /identity/v3/projects/7c1429c6830842569ae0b2cd48e3d563/users/f2e7c7b4f94b4830adc49cf2f4b84d94/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:13:39.723560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704b8e-0d93-4fe8-96cd-bdc5b72e7808 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:39.724089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704b8e-0d93-4fe8-96cd-bdc5b72e7808 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:39.724089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704b8e-0d93-4fe8-96cd-bdc5b72e7808 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:39.725478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 641/1274] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:39.731507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:39.731930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:39.732052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:39.749213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:39.750389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:39.821159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 634/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:39.844684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db704b8e-0d93-4fe8-96cd-bdc5b72e7808 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:39.947186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db704b8e-0d93-4fe8-96cd-bdc5b72e7808 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:39.964548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:39.989799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:39.990632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:39.990916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:39.991190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:40.002417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:13:40.010123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:40.011265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:40.012225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 642/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Fri May 27 03:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:40.017328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:40.096857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:40.119978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0c3ca-8da3-44c4-93ff-e6a6408c9592 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:40.167719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:40.168403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:40.168687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:40.169030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:40.169824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:40.170277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:40.171565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:40.180122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 635/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Fri May 27 03:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:40.186913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:40.305369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fde4-2f56-4d23-ba87-e2f0e3cdb353 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:40.339989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:40.340783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:40.341061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:40.341329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:40.351985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:40.353439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:40.370907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:40.371979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:40.372923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:40.372923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:40.372923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:40.372923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:40.372923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 643/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:40.377932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:40.488211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e2ee8-4a51-4f89-a41b-1f96a7156d61 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:40.526638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:40.527319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:40.527601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:40.527910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:40.528602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:40.528903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:40.530330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:40.544201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 636/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:40.549985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:40.581145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:40.649837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169325c3-28b0-4afa-b794-c97ea843e256 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:40.682688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:40.683489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:40.683771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:40.684048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:40.691515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:40.692953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:13:40.707613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:40.708762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:40.710062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 644/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:40.715428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:40.719208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:40.816400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046bbff-b671-4e09-9432-5513397ada55 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:40.854188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:40.854764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:40.855044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:40.855315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:40.856143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:40.856444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:40.857872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:40.876189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 637/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Fri May 27 03:13:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:40.882075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:40.970649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:40.980767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc046e-39a0-49e4-a9be-0211adf88ca6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:41.014600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:41.015244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:41.015523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:41.015790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:41.081987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:41.083449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:41.173932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:41.185227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 645/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Fri May 27 03:13:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:13:41.191103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:41.252860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:41.291884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca98b8-d0a1-4259-9870-9333a0cd9665 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:41.325792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:41.326610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:41.326893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:41.327167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:41.337004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:41.338797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:13:41.356686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:41.357795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:41.358777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:13:41.358777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:13:41.358777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:13:41.358777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:41.358777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 638/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:41.363533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:41.466794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4005a-dff1-4b03-b8fb-c8131c87ba21 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:41.503631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:41.504311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:41.504593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:41.504894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:41.505614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:41.505920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:41.507329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:41.519693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 646/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Fri May 27 03:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:41.526198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:41.624944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2def80-6eaf-496b-8138-7db5ab273e17 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:41.639181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:41.658742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:41.659529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:41.659812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:41.660092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:41.666632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:41.668075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:13:41.682149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:41.684077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 27 03:13:41.687119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 639/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Fri May 27 03:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:41.691088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:41.741247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:41.791211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35886cd9-2ab9-4421-beb1-9a430cb58bc4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:41.830302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:41.830971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:41.831250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:41.831526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:41.832320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:41.832627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:41.834093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8ebe-7c40-46f0-9c44-8a5b1ebaab2b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:41.847272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 647/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Fri May 27 03:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:41.854358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:41.952553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c595d-7d61-4e3d-9efb-3dc10f5d9ef6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:41.986234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:41.987046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:41.987332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:41.987606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:41.988419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] RBAC: Adding query filter params (role.id=d0122fde930842079d42ce76139767e2, scope.project.id=7c1429c6830842569ae0b2cd48e3d563, user.id=f2e7c7b4f94b4830adc49cf2f4b84d94) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:41.988724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:41.990188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e198a-f88d-492e-afcc-759b4e2ba2ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:41.996113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 640/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Fri May 27 03:13:41 2022] GET /identity/v3/role_assignments?user.id=f2e7c7b4f94b4830adc49cf2f4b84d94&scope.project.id=7c1429c6830842569ae0b2cd48e3d563&role.id=d0122fde930842079d42ce76139767e2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:44.254645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdad2e-8df7-4782-9766-74feb3eccec1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:44.255316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdad2e-8df7-4782-9766-74feb3eccec1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:44.255316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdad2e-8df7-4782-9766-74feb3eccec1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:44.257227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 648/1288] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:44.263387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:44.263861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:44.264041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:44.283618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:44.285001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:44.314236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:44.353454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 641/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:44.375446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdad2e-8df7-4782-9766-74feb3eccec1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:44.475101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdad2e-8df7-4782-9766-74feb3eccec1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:44.485412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:44.508920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:44.510200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:44.510483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:44.510757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:44.511415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:44.512797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:44.525450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:44.526763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:44.527885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 649/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:13:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:44.532691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:44.631396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160cba-8f0a-437f-8015-e53bafc51fef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:44.664872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:44.665523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:44.665798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:44.666094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:44.666797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:44.667097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:44.668461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb14f3-acf8-44ee-8ae3-279c7802f962 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:44.673286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 642/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Fri May 27 03:13:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:44.679405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:44.778645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1574-1a5d-44dd-97d2-d8719a0648e2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:44.813254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:44.813915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:44.814236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:44.814509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:44.815236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:44.815542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:44.816906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a32cf-cb29-4ac2-bf17-c500e96a655c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:44.821293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 650/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Fri May 27 03:13:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:47.034628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0a29-630a-403a-b5eb-c9d68198ec14 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:47.035208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0a29-630a-403a-b5eb-c9d68198ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:47.035208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0a29-630a-403a-b5eb-c9d68198ec14 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:47.036552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 643/1293] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:47.042469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ea81-3e58-41fe-97f9-aff4d874f4f4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:47.042898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ea81-3e58-41fe-97f9-aff4d874f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:47.043024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ea81-3e58-41fe-97f9-aff4d874f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:47.059562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7825ea81-3e58-41fe-97f9-aff4d874f4f4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:47.060772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7825ea81-3e58-41fe-97f9-aff4d874f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:47.091615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:47.129680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 651/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:13:47.153221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0a29-630a-403a-b5eb-c9d68198ec14 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:47.186286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:47.267000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0a29-630a-403a-b5eb-c9d68198ec14 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:47.303856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d52ce-51ce-43cc-9936-e8520aac3a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:47.304444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d52ce-51ce-43cc-9936-e8520aac3a66 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:47.304727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d52ce-51ce-43cc-9936-e8520aac3a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:47.304998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d52ce-51ce-43cc-9936-e8520aac3a66 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:47.305721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d52ce-51ce-43cc-9936-e8520aac3a66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:47.307181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d52ce-51ce-43cc-9936-e8520aac3a66 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:47.321094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 644/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Fri May 27 03:13:47 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:13:49.559362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700bb54-16be-4433-8c3c-63b42b3e097a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:49.559932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700bb54-16be-4433-8c3c-63b42b3e097a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:49.559932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700bb54-16be-4433-8c3c-63b42b3e097a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:49.561298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 652/1296] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:49.567194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:49.567726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:49.567726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:49.584970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:49.586227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:49.658045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 645/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:49.681881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700bb54-16be-4433-8c3c-63b42b3e097a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:49.782692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700bb54-16be-4433-8c3c-63b42b3e097a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:49.815091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:49.815886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:49.816163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:49.816433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:49.817077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:49.818491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:49.831511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:49.832737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:49.833627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 653/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:13:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:49.839992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:49.858545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:49.943549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642f194-58a8-4b68-b2dc-fa3af9624a22 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:49.977198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:49.978545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:49.978832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:49.979109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:49.979806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:49.980113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:49.981487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:49.986608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 646/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Fri May 27 03:13:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:49.994130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:50.025510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:50.098415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd672cd8-d4f1-4fd2-8fcf-0248a45abafb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:50.131970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:50.132631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:50.132915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:50.133193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:50.134043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] RBAC: Adding query filter params (interface=public, service_id=9b3334cb49d14780a79cba2855afa6c6, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:50.134360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:50.135739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca65b17-6791-41ef-a64c-addb4a260e14 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:50.140976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 654/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Fri May 27 03:13:49 2022] GET /identity/v3/endpoints?service_id=9b3334cb49d14780a79cba2855afa6c6&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:50.146550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:50.231511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:50.252557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0cc15-7021-4f69-80ed-53f478411448 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:50.293710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507168ce-676f-45a5-8187-3e77fc524d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:50.294636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507168ce-676f-45a5-8187-3e77fc524d85 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:50.294993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507168ce-676f-45a5-8187-3e77fc524d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:50.295319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507168ce-676f-45a5-8187-3e77fc524d85 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:50.296179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507168ce-676f-45a5-8187-3e77fc524d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:50.297778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507168ce-676f-45a5-8187-3e77fc524d85 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:50.305395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 647/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Fri May 27 03:13:50 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:13:52.507836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16015d68-79ba-4bd6-851f-61b9e8da3fca None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:52.508365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16015d68-79ba-4bd6-851f-61b9e8da3fca None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:52.508365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16015d68-79ba-4bd6-851f-61b9e8da3fca None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:52.509811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 655/1302] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:13:52.515158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:52.515571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:52.515809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:52.532276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:13:52.533447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:13:52.601072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 648/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:13:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:13:52.625527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16015d68-79ba-4bd6-851f-61b9e8da3fca None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:52.717272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:52.726453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16015d68-79ba-4bd6-851f-61b9e8da3fca None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:52.760624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:52.761337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:52.761613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:52.761883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:52.762554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:52.763916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:13:52.775546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:13:52.776714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 27 03:13:52.777709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 656/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Fri May 27 03:13:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:13:52.782825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:52.859332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:13:52.883825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eada975-7a30-42b4-affb-4f1bebbbb566 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:52.917747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:52.918441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:52.918727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:52.919006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:52.919704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:13:52.920010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:52.921374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271c81-21c4-4cb2-bfdc-026c2fd94661 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:52.926468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 649/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Fri May 27 03:13:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:13:52.932222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:13:53.030806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dd9f5-8e1f-48c9-9f5c-0f9ea64d3a58 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:13:53.063498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76204e78-8889-49c1-8570-3d2b2f7a3dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:13:53.064152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204e78-8889-49c1-8570-3d2b2f7a3dda None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:13:53.064432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204e78-8889-49c1-8570-3d2b2f7a3dda None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:13:53.064707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204e78-8889-49c1-8570-3d2b2f7a3dda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:13:53.065470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76204e78-8889-49c1-8570-3d2b2f7a3dda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:13:53.066860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76204e78-8889-49c1-8570-3d2b2f7a3dda None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:13:53.084700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 657/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Fri May 27 03:13:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:14:02.923545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=30 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:14:03.080445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:00.247610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50377-3b6b-4e08-b60f-317bbe8be80c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:00.248215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50377-3b6b-4e08-b60f-317bbe8be80c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:00.248215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50377-3b6b-4e08-b60f-317bbe8be80c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:00.249591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 650/1307] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:00.255038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fd79-27f0-4f4e-a75d-4d436e5b153c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:00.255588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fd79-27f0-4f4e-a75d-4d436e5b153c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:00.255588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fd79-27f0-4f4e-a75d-4d436e5b153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:00.449557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cb99fd79-27f0-4f4e-a75d-4d436e5b153c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:00.451025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cb99fd79-27f0-4f4e-a75d-4d436e5b153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:00.747619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 658/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:00.798735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5e8f-6230-4271-bd08-fcd70b2dfb7f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:00.799393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5e8f-6230-4271-bd08-fcd70b2dfb7f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:00.799897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5e8f-6230-4271-bd08-fcd70b2dfb7f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:00.801842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 651/1309] 10.222.0.61 () {54 vars in 964 bytes} [Fri May 27 03:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:00.808408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0e7ec-fbef-4e79-9994-4fcc5f74cb4d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:00.808696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0e7ec-fbef-4e79-9994-4fcc5f74cb4d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:00.808968 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0e7ec-fbef-4e79-9994-4fcc5f74cb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:00.905722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-57d0e7ec-fbef-4e79-9994-4fcc5f74cb4d None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:00.907195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57d0e7ec-fbef-4e79-9994-4fcc5f74cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:00.938967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:01.004088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 659/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Fri May 27 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:01.012773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f5e8f-6230-4271-bd08-fcd70b2dfb7f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:01.015104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ed4f5e8f-6230-4271-bd08-fcd70b2dfb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:01.156056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f5e8f-6230-4271-bd08-fcd70b2dfb7f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:01.239943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:01.240648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:01.240939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:01.241210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:01.243010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:01.304609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:01.372041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:01.373491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2c6a-6ee6-46c6-ad70-c04b097ec33c service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:01.394040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 652/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:03.984556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462b00-0d7b-4c3d-91f5-1728b81e0738 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:03.985167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462b00-0d7b-4c3d-91f5-1728b81e0738 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:03.985167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462b00-0d7b-4c3d-91f5-1728b81e0738 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:03.986558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 660/1312] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:03.992529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e305d-2e05-46c4-b45b-259d877e9986 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:03.993119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e305d-2e05-46c4-b45b-259d877e9986 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:03.993119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e305d-2e05-46c4-b45b-259d877e9986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:04.067231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-930e305d-2e05-46c4-b45b-259d877e9986 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:04.068517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-930e305d-2e05-46c4-b45b-259d877e9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:04.168953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 653/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:04.206520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37462b00-0d7b-4c3d-91f5-1728b81e0738 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:04.208077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-37462b00-0d7b-4c3d-91f5-1728b81e0738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:04.320500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37462b00-0d7b-4c3d-91f5-1728b81e0738 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:04.403773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:04.406639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:04.407384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:04.407932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:04.408191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:04.410318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:04.530692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:04.532648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef5676-df8c-4d64-8913-f4be0785aa84 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:04.556917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 661/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:07.169033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe47e-940b-454c-8f26-28f309997d22 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:07.169577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe47e-940b-454c-8f26-28f309997d22 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:07.169577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffe47e-940b-454c-8f26-28f309997d22 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:07.170999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 654/1315] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:07.176242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d3f2-ea5f-448f-a510-c3706ea26325 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:07.176683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d3f2-ea5f-448f-a510-c3706ea26325 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:07.176780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7d3f2-ea5f-448f-a510-c3706ea26325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:07.241981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6de7d3f2-ea5f-448f-a510-c3706ea26325 None None] MFA Rules not processed for user `0ba528083e754b4f8ef5b418a22cc985`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:07.243205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6de7d3f2-ea5f-448f-a510-c3706ea26325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:07.294810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:07.339280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 662/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:07.391098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16a08-0dfb-4216-bee2-a1a4d2680c26 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:07.391387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16a08-0dfb-4216-bee2-a1a4d2680c26 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:07.391663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16a08-0dfb-4216-bee2-a1a4d2680c26 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:07.393059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 655/1317] 10.222.0.61 () {54 vars in 964 bytes} [Fri May 27 03:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:07.399528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0175c-6525-43a3-b0c7-c310e9f98477 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:07.399817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0175c-6525-43a3-b0c7-c310e9f98477 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:07.400092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0175c-6525-43a3-b0c7-c310e9f98477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:07.474610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a8c0175c-6525-43a3-b0c7-c310e9f98477 None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:07.476420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a8c0175c-6525-43a3-b0c7-c310e9f98477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:07.553246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 663/1318] 10.222.0.61 () {58 vars in 1061 bytes} [Fri May 27 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:15:07.562831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16a08-0dfb-4216-bee2-a1a4d2680c26 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:07.564387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-20a16a08-0dfb-4216-bee2-a1a4d2680c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:07.574774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:07.669274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16a08-0dfb-4216-bee2-a1a4d2680c26 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:07.741473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:07.742060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:07.742340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:07.742608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:07.744234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:07.807693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:07.855099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:07.856545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8db70-dd20-4f63-a889-df19c12ba6e3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:07.876229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 656/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:11.039103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f9b3-27eb-4721-afd9-e2ff0748677b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:11.039656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f9b3-27eb-4721-afd9-e2ff0748677b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:11.039656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f9b3-27eb-4721-afd9-e2ff0748677b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:11.041002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 664/1320] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:11.046725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d8ac-1dc5-4893-9d09-06d2eb211176 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:11.047419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d8ac-1dc5-4893-9d09-06d2eb211176 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:11.047672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d8ac-1dc5-4893-9d09-06d2eb211176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:11.113359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c454d8ac-1dc5-4893-9d09-06d2eb211176 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:11.114610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c454d8ac-1dc5-4893-9d09-06d2eb211176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:11.214022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 657/1321] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:11.255306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f9b3-27eb-4721-afd9-e2ff0748677b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:11.256902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b838f9b3-27eb-4721-afd9-e2ff0748677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:11.306559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:11.359615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f9b3-27eb-4721-afd9-e2ff0748677b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:11.433110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:11.433750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:11.434057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:11.434331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:11.435967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:11.533044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:11.547215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:11.548743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef590088-593c-46f9-b63e-b2e20f79269e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:11.566664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 665/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:14.534325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567531c-8bae-415b-b1eb-61aded8d7ca8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:14.534917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567531c-8bae-415b-b1eb-61aded8d7ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:14.534917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567531c-8bae-415b-b1eb-61aded8d7ca8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:14.536272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 658/1323] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:14.542337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac34e7-3a4a-4544-990c-a53c8971a04a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:14.542816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac34e7-3a4a-4544-990c-a53c8971a04a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:14.542920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac34e7-3a4a-4544-990c-a53c8971a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:14.608827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7aac34e7-3a4a-4544-990c-a53c8971a04a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:14.610133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7aac34e7-3a4a-4544-990c-a53c8971a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:14.706773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 666/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:14.743472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567531c-8bae-415b-b1eb-61aded8d7ca8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:14.744935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7567531c-8bae-415b-b1eb-61aded8d7ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:14.764301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:14.851523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567531c-8bae-415b-b1eb-61aded8d7ca8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:14.929912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:14.930604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:14.930906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:14.931175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:14.932800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:15.009436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:15.049394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:15.050918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbdf21-0b0b-402e-b7fc-e9b4a871a657 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:15.070985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 659/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:17.369334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff63ef-0d5e-4bd3-8fa6-94b003dd27b3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:17.369914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff63ef-0d5e-4bd3-8fa6-94b003dd27b3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:17.369914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff63ef-0d5e-4bd3-8fa6-94b003dd27b3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:17.371301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 667/1326] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:17.376909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70728-b05a-4924-afad-bc4ac630ddf7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:17.377414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70728-b05a-4924-afad-bc4ac630ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:17.377528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd70728-b05a-4924-afad-bc4ac630ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:17.445452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4bd70728-b05a-4924-afad-bc4ac630ddf7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:17.446706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bd70728-b05a-4924-afad-bc4ac630ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:17.553328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 660/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:17.590740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff63ef-0d5e-4bd3-8fa6-94b003dd27b3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:17.592351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2bff63ef-0d5e-4bd3-8fa6-94b003dd27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:17.657694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:17.701549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff63ef-0d5e-4bd3-8fa6-94b003dd27b3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:17.773955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:17.774631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:17.774912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:17.775182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:17.776792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:17.886419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:17.889212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:17.891181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b65c9-aeaf-44a0-b7c5-7cab5a9101ca service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:17.909721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 668/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:20.198542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d268-ef54-4d7c-b1dc-cecce390d6a3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:20.199061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d268-ef54-4d7c-b1dc-cecce390d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:20.199155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854d268-ef54-4d7c-b1dc-cecce390d6a3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:20.200481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 661/1329] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:20.206187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53593f-81aa-4f17-bd25-2837fa2e313f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:20.206690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53593f-81aa-4f17-bd25-2837fa2e313f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:20.206882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53593f-81aa-4f17-bd25-2837fa2e313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:20.277015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6e53593f-81aa-4f17-bd25-2837fa2e313f None None] MFA Rules not processed for user `0ba528083e754b4f8ef5b418a22cc985`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:20.278280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6e53593f-81aa-4f17-bd25-2837fa2e313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:20.382538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 669/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:20.419510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854d268-ef54-4d7c-b1dc-cecce390d6a3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:20.421038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c854d268-ef54-4d7c-b1dc-cecce390d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:20.453927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:20.534140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854d268-ef54-4d7c-b1dc-cecce390d6a3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:20.611045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:20.611686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:20.611964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:20.612232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:20.613847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:20.700634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:20.735336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:20.736725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4e2bf-935a-4630-92eb-e78693ea632a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:20.755186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 662/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:23.253609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9051b-aad9-491d-8636-59b6cf5d9f63 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:23.254191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9051b-aad9-491d-8636-59b6cf5d9f63 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:23.254191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9051b-aad9-491d-8636-59b6cf5d9f63 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:23.255607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 670/1332] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:23.261840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13013d-21ff-487d-ab48-f1f95a824017 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:23.262361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13013d-21ff-487d-ab48-f1f95a824017 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:23.262467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13013d-21ff-487d-ab48-f1f95a824017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:23.330207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8d13013d-21ff-487d-ab48-f1f95a824017 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:23.331331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8d13013d-21ff-487d-ab48-f1f95a824017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:23.432079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 663/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:23.468899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9051b-aad9-491d-8636-59b6cf5d9f63 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:23.470483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a6c9051b-aad9-491d-8636-59b6cf5d9f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:23.540768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:23.576177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9051b-aad9-491d-8636-59b6cf5d9f63 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:23.654701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:23.655356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:23.655643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:23.655923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:23.657585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:23.776856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:23.778372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d6874-0acd-4662-b2ec-cd9da1b04d34 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:23.790089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:23.799421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 671/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:26.116873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed480a-d76f-4146-b306-cbb93a61c53c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:26.117430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed480a-d76f-4146-b306-cbb93a61c53c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:26.117430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed480a-d76f-4146-b306-cbb93a61c53c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:26.118854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 664/1335] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:26.124323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f20a06-8616-46ae-83b1-7f13625db745 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:26.124739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f20a06-8616-46ae-83b1-7f13625db745 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:26.124875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f20a06-8616-46ae-83b1-7f13625db745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:26.190548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b8f20a06-8616-46ae-83b1-7f13625db745 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:26.191772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b8f20a06-8616-46ae-83b1-7f13625db745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:26.293569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 672/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:26.333782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed480a-d76f-4146-b306-cbb93a61c53c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:26.335975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79ed480a-d76f-4146-b306-cbb93a61c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:26.379077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:26.446808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed480a-d76f-4146-b306-cbb93a61c53c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:26.523485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:26.524141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:26.524420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:26.524694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:26.526375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:26.609461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:26.636175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:26.637536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba0195-14d3-4257-9e12-b6ad74581cf6 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:26.655466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 665/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:29.244932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c2ad-c1db-4024-8a7f-a7939a114a36 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:29.245661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c2ad-c1db-4024-8a7f-a7939a114a36 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:29.245754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c2ad-c1db-4024-8a7f-a7939a114a36 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:29.247770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 673/1338] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:29.254737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafe97-07cd-4ff5-9a9c-603026aca873 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:29.255271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafe97-07cd-4ff5-9a9c-603026aca873 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:29.255389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafe97-07cd-4ff5-9a9c-603026aca873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:29.320630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-efbafe97-07cd-4ff5-9a9c-603026aca873 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:29.321851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-efbafe97-07cd-4ff5-9a9c-603026aca873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:29.420062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 666/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:29.458019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952c2ad-c1db-4024-8a7f-a7939a114a36 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:29.460154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4952c2ad-c1db-4024-8a7f-a7939a114a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:29.539967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:29.569000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952c2ad-c1db-4024-8a7f-a7939a114a36 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:29.648457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:29.649112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:29.649395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:29.649673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:29.651371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:29.763640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:29.765082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cb34c-2ea8-4053-9abd-66ef7a15f13b service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:29.783011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 674/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:34.297883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90fe6-3e76-49dc-94e6-b2251401bfec None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:34.298483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90fe6-3e76-49dc-94e6-b2251401bfec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:34.298483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90fe6-3e76-49dc-94e6-b2251401bfec None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:34.299912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 667/1341] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:34.305846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db5f2e-2824-41a8-b1d6-60d5e86935ed None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:34.306352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db5f2e-2824-41a8-b1d6-60d5e86935ed None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:34.306590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db5f2e-2824-41a8-b1d6-60d5e86935ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:34.312888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:34.391386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-57db5f2e-2824-41a8-b1d6-60d5e86935ed None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:34.392505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57db5f2e-2824-41a8-b1d6-60d5e86935ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:34.505238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 675/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:34.544646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f90fe6-3e76-49dc-94e6-b2251401bfec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:34.546863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-06f90fe6-3e76-49dc-94e6-b2251401bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:34.601992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:34.651086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f90fe6-3e76-49dc-94e6-b2251401bfec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:34.654741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472161c5-13a9-4752-89f6-c7fd1f1283ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:34.655391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472161c5-13a9-4752-89f6-c7fd1f1283ca service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:34.655670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472161c5-13a9-4752-89f6-c7fd1f1283ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:34.655942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472161c5-13a9-4752-89f6-c7fd1f1283ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:34.665320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472161c5-13a9-4752-89f6-c7fd1f1283ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:34.666801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472161c5-13a9-4752-89f6-c7fd1f1283ca service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:34.677240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 668/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:37.581507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532335-1d3d-411e-9235-450a398ef707 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:37.582093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532335-1d3d-411e-9235-450a398ef707 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:37.582093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d532335-1d3d-411e-9235-450a398ef707 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:37.583396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 676/1344] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:37.590731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944859e1-0961-4093-bd97-5ad3bc3b4ad2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:37.591303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944859e1-0961-4093-bd97-5ad3bc3b4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:37.591303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944859e1-0961-4093-bd97-5ad3bc3b4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:37.622977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-944859e1-0961-4093-bd97-5ad3bc3b4ad2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:37.624228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-944859e1-0961-4093-bd97-5ad3bc3b4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:37.713940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 669/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:37.751495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532335-1d3d-411e-9235-450a398ef707 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:37.762806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d532335-1d3d-411e-9235-450a398ef707 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:37.766392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741beca9-b58e-4273-a79d-560263aba038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:37.767047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741beca9-b58e-4273-a79d-560263aba038 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:37.767330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741beca9-b58e-4273-a79d-560263aba038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:37.767603 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741beca9-b58e-4273-a79d-560263aba038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:37.777073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741beca9-b58e-4273-a79d-560263aba038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:37.778709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741beca9-b58e-4273-a79d-560263aba038 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:37.788974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 677/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:42.001023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881a16f-5f26-4ccb-87fa-c88a1c6ef6d6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:42.001754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881a16f-5f26-4ccb-87fa-c88a1c6ef6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:42.001754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881a16f-5f26-4ccb-87fa-c88a1c6ef6d6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:42.003034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 670/1347] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:42.009640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1343ec-ec13-49b3-a143-aa05c5c4a79f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:42.010464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1343ec-ec13-49b3-a143-aa05c5c4a79f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:42.010640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1343ec-ec13-49b3-a143-aa05c5c4a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:42.033677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ea1343ec-ec13-49b3-a143-aa05c5c4a79f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:42.034951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea1343ec-ec13-49b3-a143-aa05c5c4a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:42.042944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 678/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:42.082154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881a16f-5f26-4ccb-87fa-c88a1c6ef6d6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:42.095092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881a16f-5f26-4ccb-87fa-c88a1c6ef6d6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:42.098952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f516e6a-beca-4db3-9a6e-13f64eb21870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:42.099622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f516e6a-beca-4db3-9a6e-13f64eb21870 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:42.099900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f516e6a-beca-4db3-9a6e-13f64eb21870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:42.100174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f516e6a-beca-4db3-9a6e-13f64eb21870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:42.111013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f516e6a-beca-4db3-9a6e-13f64eb21870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:42.112474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f516e6a-beca-4db3-9a6e-13f64eb21870 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:42.122507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 671/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:15:47.649465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84511-7464-43cd-a440-e98ed712b5b3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:47.650513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84511-7464-43cd-a440-e98ed712b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:47.650999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84511-7464-43cd-a440-e98ed712b5b3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:47.652809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 679/1350] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:47.659131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02870d12-5589-4ad5-8dfc-698d82aa8325 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:47.659577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02870d12-5589-4ad5-8dfc-698d82aa8325 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:47.660688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02870d12-5589-4ad5-8dfc-698d82aa8325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:47.791631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-02870d12-5589-4ad5-8dfc-698d82aa8325 None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:47.793125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02870d12-5589-4ad5-8dfc-698d82aa8325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:47.824612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:47.885787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 672/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:52.028393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=72 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:52.291779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df026a2-16be-439b-b948-846154bc1275 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:52.292142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df026a2-16be-439b-b948-846154bc1275 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:52.292383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df026a2-16be-439b-b948-846154bc1275 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:52.293711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 680/1352] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:52.299052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b165-0d65-496f-b549-c6ab1856b361 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:52.299530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b165-0d65-496f-b549-c6ab1856b361 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:52.299638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b165-0d65-496f-b549-c6ab1856b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:52.324412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d675b165-0d65-496f-b549-c6ab1856b361 None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:52.325705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d675b165-0d65-496f-b549-c6ab1856b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:52.335020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 673/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:15:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:53.964750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064833-3596-4d08-b011-fd5196af3860 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:53.965347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064833-3596-4d08-b011-fd5196af3860 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:53.965448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064833-3596-4d08-b011-fd5196af3860 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:53.966917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 681/1354] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:53.972261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e3fd-d260-4fe7-9307-d2c0ed08d86b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:53.972745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e3fd-d260-4fe7-9307-d2c0ed08d86b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:53.972828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e3fd-d260-4fe7-9307-d2c0ed08d86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:53.991828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6052e3fd-d260-4fe7-9307-d2c0ed08d86b None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:53.993075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6052e3fd-d260-4fe7-9307-d2c0ed08d86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:54.001612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 674/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:15:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:15:58.115413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad4209-9b19-4fea-baa6-8d6101ab7551 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:58.115914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad4209-9b19-4fea-baa6-8d6101ab7551 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:58.116014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad4209-9b19-4fea-baa6-8d6101ab7551 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:58.117593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 682/1356] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:58.123149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86a27e-2758-4a2f-a02d-5b78b155937c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:58.124061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86a27e-2758-4a2f-a02d-5b78b155937c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:58.124578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86a27e-2758-4a2f-a02d-5b78b155937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:58.144448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1e86a27e-2758-4a2f-a02d-5b78b155937c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:58.146317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1e86a27e-2758-4a2f-a02d-5b78b155937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:58.154387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 675/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:58.210637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab810-20ae-4e5d-a88b-2affc1b5b954 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:58.211601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab810-20ae-4e5d-a88b-2affc1b5b954 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:58.213469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab810-20ae-4e5d-a88b-2affc1b5b954 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:58.217081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 683/1358] 10.222.0.61 () {54 vars in 961 bytes} [Fri May 27 03:15:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:15:58.228944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba47c6-e306-4cea-9df4-8d85afdd9d4f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:58.229235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba47c6-e306-4cea-9df4-8d85afdd9d4f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:58.229682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba47c6-e306-4cea-9df4-8d85afdd9d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:58.282628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e4ba47c6-e306-4cea-9df4-8d85afdd9d4f None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:15:58.283955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4ba47c6-e306-4cea-9df4-8d85afdd9d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:15:58.370857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 676/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Fri May 27 03:15:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:15:58.378562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ab810-20ae-4e5d-a88b-2affc1b5b954 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:15:58.393954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ab810-20ae-4e5d-a88b-2affc1b5b954 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:15:58.400833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe70613-465d-465c-99b1-1fcd2f4655f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:15:58.401484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe70613-465d-465c-99b1-1fcd2f4655f9 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:15:58.401821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe70613-465d-465c-99b1-1fcd2f4655f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:15:58.402164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe70613-465d-465c-99b1-1fcd2f4655f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:15:58.413094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe70613-465d-465c-99b1-1fcd2f4655f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:15:58.415250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe70613-465d-465c-99b1-1fcd2f4655f9 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:15:58.426865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 684/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:00.924161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f01cc-1944-459f-bf22-3d5884681dd0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:00.924673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f01cc-1944-459f-bf22-3d5884681dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:00.924673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f01cc-1944-459f-bf22-3d5884681dd0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:00.926199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 677/1361] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:00.936566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557041-312a-43e8-a54d-91d26180dc33 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:00.937125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557041-312a-43e8-a54d-91d26180dc33 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:00.937125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557041-312a-43e8-a54d-91d26180dc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:00.955497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5557041-312a-43e8-a54d-91d26180dc33 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:00.956703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5557041-312a-43e8-a54d-91d26180dc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:00.965185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 685/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:16:01.010202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f01cc-1944-459f-bf22-3d5884681dd0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:01.025041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f01cc-1944-459f-bf22-3d5884681dd0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:01.030611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346845-f83d-4a30-8f8e-5e4c9e9388a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:01.031264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346845-f83d-4a30-8f8e-5e4c9e9388a3 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:01.031544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346845-f83d-4a30-8f8e-5e4c9e9388a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:01.031823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346845-f83d-4a30-8f8e-5e4c9e9388a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:01.043564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346845-f83d-4a30-8f8e-5e4c9e9388a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:01.043564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346845-f83d-4a30-8f8e-5e4c9e9388a3 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:01.054951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 678/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:03.667868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dc07b-aae8-4b2d-9616-157699725694 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:03.668287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dc07b-aae8-4b2d-9616-157699725694 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:03.668376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dc07b-aae8-4b2d-9616-157699725694 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:03.669782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 686/1364] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:03.675870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2079e2-8457-4215-9717-0369c26c323f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:03.676373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2079e2-8457-4215-9717-0369c26c323f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:03.676533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2079e2-8457-4215-9717-0369c26c323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:03.694996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1b2079e2-8457-4215-9717-0369c26c323f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:03.696369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1b2079e2-8457-4215-9717-0369c26c323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:03.709261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 679/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:16:03.764277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152a21-be94-4dde-8944-30da9e5d5c26 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:03.764843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152a21-be94-4dde-8944-30da9e5d5c26 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:03.765283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152a21-be94-4dde-8944-30da9e5d5c26 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:03.767784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 687/1366] 10.222.0.61 () {54 vars in 961 bytes} [Fri May 27 03:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:03.774112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df556589-6ae0-45bd-a551-471827bfb025 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:03.774735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df556589-6ae0-45bd-a551-471827bfb025 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:03.775165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df556589-6ae0-45bd-a551-471827bfb025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:03.796151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-df556589-6ae0-45bd-a551-471827bfb025 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:03.797385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-df556589-6ae0-45bd-a551-471827bfb025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:03.808844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 680/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Fri May 27 03:16:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:16:03.815066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152a21-be94-4dde-8944-30da9e5d5c26 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:03.829535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152a21-be94-4dde-8944-30da9e5d5c26 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:03.835446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f98927-e548-4805-bbb5-5998364e6622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:03.836089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f98927-e548-4805-bbb5-5998364e6622 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:03.836369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f98927-e548-4805-bbb5-5998364e6622 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:03.836639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f98927-e548-4805-bbb5-5998364e6622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:03.845270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f98927-e548-4805-bbb5-5998364e6622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:03.846901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f98927-e548-4805-bbb5-5998364e6622 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:03.857537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 688/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:06.240992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789839db-5ef3-4723-98d0-17c28adae0e6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.241697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789839db-5ef3-4723-98d0-17c28adae0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.241697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789839db-5ef3-4723-98d0-17c28adae0e6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.243091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 681/1369] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:06.249407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2499ee-5ecf-422a-8891-6085b53e365d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.249942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2499ee-5ecf-422a-8891-6085b53e365d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.250170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2499ee-5ecf-422a-8891-6085b53e365d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.269560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2f2499ee-5ecf-422a-8891-6085b53e365d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:06.271450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2f2499ee-5ecf-422a-8891-6085b53e365d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:06.279758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 689/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:06.324944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789839db-5ef3-4723-98d0-17c28adae0e6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:06.341177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789839db-5ef3-4723-98d0-17c28adae0e6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:06.347833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3c258-f931-4826-8a80-5319b5d2271e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:06.349502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c258-f931-4826-8a80-5319b5d2271e service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.350024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c258-f931-4826-8a80-5319b5d2271e service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.350479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c258-f931-4826-8a80-5319b5d2271e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.361356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3c258-f931-4826-8a80-5319b5d2271e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:06.363372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3c258-f931-4826-8a80-5319b5d2271e service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:06.375759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 682/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:06.549470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3d93-ed0f-4a52-8f40-55eca361b354 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.549754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3d93-ed0f-4a52-8f40-55eca361b354 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.550270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3d93-ed0f-4a52-8f40-55eca361b354 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.552028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 690/1372] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:06.557902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4c6b-4add-488e-8e8e-3073f1e5e8c3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.558298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4c6b-4add-488e-8e8e-3073f1e5e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.558500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d4c6b-4add-488e-8e8e-3073f1e5e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.579088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b59d4c6b-4add-488e-8e8e-3073f1e5e8c3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:06.580331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b59d4c6b-4add-488e-8e8e-3073f1e5e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:06.590022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 683/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:06.921060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8cb6c-8fdc-49b6-ba1a-e14ac6757a56 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.921733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8cb6c-8fdc-49b6-ba1a-e14ac6757a56 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.921733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8cb6c-8fdc-49b6-ba1a-e14ac6757a56 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.923700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 691/1374] 10.222.0.61 () {54 vars in 963 bytes} [Fri May 27 03:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:06.930809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a742c-3bd7-4356-a2f8-a2ec2b07f1e4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:06.931237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a742c-3bd7-4356-a2f8-a2ec2b07f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:06.931620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a742c-3bd7-4356-a2f8-a2ec2b07f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:06.938360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:06.992215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-aa0a742c-3bd7-4356-a2f8-a2ec2b07f1e4 None None] MFA Rules not processed for user `b8bc75da330c48aab2b15609eb495cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:06.993601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aa0a742c-3bd7-4356-a2f8-a2ec2b07f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:07.061306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 684/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Fri May 27 03:16:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:07.069087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8cb6c-8fdc-49b6-ba1a-e14ac6757a56 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:07.080702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8cb6c-8fdc-49b6-ba1a-e14ac6757a56 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:07.086971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67260-ec6f-49de-b07f-80673016fbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:07.087796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67260-ec6f-49de-b07f-80673016fbad service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:07.088445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67260-ec6f-49de-b07f-80673016fbad service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:07.088816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67260-ec6f-49de-b07f-80673016fbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:07.099673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c67260-ec6f-49de-b07f-80673016fbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:07.101272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c67260-ec6f-49de-b07f-80673016fbad service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:07.115146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 692/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:08.742827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435a06-fb04-4e00-9d1a-a39b6aab48d2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:08.743380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435a06-fb04-4e00-9d1a-a39b6aab48d2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:08.743380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435a06-fb04-4e00-9d1a-a39b6aab48d2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:08.744669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 685/1377] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:08.750468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3513-1c6a-45bc-b1cb-cccf6c0477d8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:08.751033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3513-1c6a-45bc-b1cb-cccf6c0477d8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:08.751211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3513-1c6a-45bc-b1cb-cccf6c0477d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:08.771117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-89ef3513-1c6a-45bc-b1cb-cccf6c0477d8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:08.772338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-89ef3513-1c6a-45bc-b1cb-cccf6c0477d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:08.780355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 693/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:08.826737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435a06-fb04-4e00-9d1a-a39b6aab48d2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:08.842533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435a06-fb04-4e00-9d1a-a39b6aab48d2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:08.848305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b8cc0-e1d8-41ba-9df2-12a1a9f36e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:08.849614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b8cc0-e1d8-41ba-9df2-12a1a9f36e70 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:08.849900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b8cc0-e1d8-41ba-9df2-12a1a9f36e70 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:08.850205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b8cc0-e1d8-41ba-9df2-12a1a9f36e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:08.859465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b8cc0-e1d8-41ba-9df2-12a1a9f36e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:08.861101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b8cc0-e1d8-41ba-9df2-12a1a9f36e70 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:08.872418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 686/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:11.173187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f54e-eff9-4289-81c5-8dbe92845537 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:11.174114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f54e-eff9-4289-81c5-8dbe92845537 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:11.174401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f54e-eff9-4289-81c5-8dbe92845537 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:11.175796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 694/1380] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:11.181974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bd15-db29-4894-82e8-247c3610cbd7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:11.182550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bd15-db29-4894-82e8-247c3610cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:11.182550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341bd15-db29-4894-82e8-247c3610cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:11.202054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3341bd15-db29-4894-82e8-247c3610cbd7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:11.203300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3341bd15-db29-4894-82e8-247c3610cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:11.212144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 687/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:11.257870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20f54e-eff9-4289-81c5-8dbe92845537 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:11.273087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20f54e-eff9-4289-81c5-8dbe92845537 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:11.278734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f08556-9ef4-471b-8ed3-9359bfc6c2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:11.279383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08556-9ef4-471b-8ed3-9359bfc6c2f5 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:11.279663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08556-9ef4-471b-8ed3-9359bfc6c2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:11.279932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08556-9ef4-471b-8ed3-9359bfc6c2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:11.288903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f08556-9ef4-471b-8ed3-9359bfc6c2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:11.290538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f08556-9ef4-471b-8ed3-9359bfc6c2f5 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:11.300753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 695/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:13.598061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45d65-204c-489d-942a-2251f67cbec9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:13.599206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45d65-204c-489d-942a-2251f67cbec9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:13.599206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45d65-204c-489d-942a-2251f67cbec9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:13.600538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 688/1383] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:13.606160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6284df-34e4-4cba-854c-108cfc1028c1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:13.606685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6284df-34e4-4cba-854c-108cfc1028c1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:13.606685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6284df-34e4-4cba-854c-108cfc1028c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:13.626859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bc6284df-34e4-4cba-854c-108cfc1028c1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:13.628258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bc6284df-34e4-4cba-854c-108cfc1028c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:13.638508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 696/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:13.682855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f45d65-204c-489d-942a-2251f67cbec9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:13.698090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f45d65-204c-489d-942a-2251f67cbec9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:13.703944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832506b9-185e-42a9-80fa-e494745dcf00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:13.704630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832506b9-185e-42a9-80fa-e494745dcf00 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:13.704894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832506b9-185e-42a9-80fa-e494745dcf00 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:13.705342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832506b9-185e-42a9-80fa-e494745dcf00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:13.714883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832506b9-185e-42a9-80fa-e494745dcf00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:13.716812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832506b9-185e-42a9-80fa-e494745dcf00 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:13.728856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 689/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:16.011943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b536-458d-41b3-839f-637fc677e33f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:16.012618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b536-458d-41b3-839f-637fc677e33f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:16.012728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b536-458d-41b3-839f-637fc677e33f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:16.014641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 697/1386] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:16.022058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584b6e-94b9-4010-8c15-3b09e5053e17 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:16.022774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584b6e-94b9-4010-8c15-3b09e5053e17 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:16.022774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584b6e-94b9-4010-8c15-3b09e5053e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:16.049362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d3584b6e-94b9-4010-8c15-3b09e5053e17 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:16.050666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d3584b6e-94b9-4010-8c15-3b09e5053e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:16.060594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 690/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:16.121418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b536-458d-41b3-839f-637fc677e33f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:16.140113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b536-458d-41b3-839f-637fc677e33f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:16.148182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d983c25-904c-4264-8490-f749fd6b1965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:16.149264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d983c25-904c-4264-8490-f749fd6b1965 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:16.149685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d983c25-904c-4264-8490-f749fd6b1965 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:16.150078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d983c25-904c-4264-8490-f749fd6b1965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:16.162844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d983c25-904c-4264-8490-f749fd6b1965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:16.165222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d983c25-904c-4264-8490-f749fd6b1965 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:16.179056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 698/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:16:18.900663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cb59f-cbd1-4160-a2df-2fc50bab3a99 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:18.901366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cb59f-cbd1-4160-a2df-2fc50bab3a99 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:18.901366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cb59f-cbd1-4160-a2df-2fc50bab3a99 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:18.902566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 691/1389] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:18.908362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676e181-c741-4ee8-b0c0-20a2906e32c6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:18.913132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676e181-c741-4ee8-b0c0-20a2906e32c6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:18.913132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676e181-c741-4ee8-b0c0-20a2906e32c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:18.930473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a676e181-c741-4ee8-b0c0-20a2906e32c6 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:18.931704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a676e181-c741-4ee8-b0c0-20a2906e32c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:18.940720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 699/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:18.998239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cb59f-cbd1-4160-a2df-2fc50bab3a99 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:19.013424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cb59f-cbd1-4160-a2df-2fc50bab3a99 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:19.019053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e9e72-ddba-46d5-a835-f9d8e922054a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:19.019702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9e72-ddba-46d5-a835-f9d8e922054a service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:19.019987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9e72-ddba-46d5-a835-f9d8e922054a service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:19.020412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9e72-ddba-46d5-a835-f9d8e922054a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:19.029608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9e72-ddba-46d5-a835-f9d8e922054a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:19.031354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9e72-ddba-46d5-a835-f9d8e922054a service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:19.042259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 692/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:21.466335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c339b-3536-490d-8067-3e9471a363d6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:21.466999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c339b-3536-490d-8067-3e9471a363d6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:21.466999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c339b-3536-490d-8067-3e9471a363d6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:21.468247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 700/1392] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:21.474341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e907-bae5-4205-a405-a7c445022f82 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:21.474861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e907-bae5-4205-a405-a7c445022f82 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:21.474972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e907-bae5-4205-a405-a7c445022f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:21.492965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2e50e907-bae5-4205-a405-a7c445022f82 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:21.494188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2e50e907-bae5-4205-a405-a7c445022f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:21.502088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 693/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:21.547331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c339b-3536-490d-8067-3e9471a363d6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:21.561945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c339b-3536-490d-8067-3e9471a363d6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:21.567521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda48d-d0e5-4994-940b-9ae7e0e9d18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:21.568175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda48d-d0e5-4994-940b-9ae7e0e9d18e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:21.568458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda48d-d0e5-4994-940b-9ae7e0e9d18e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:21.568743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda48d-d0e5-4994-940b-9ae7e0e9d18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:21.577643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda48d-d0e5-4994-940b-9ae7e0e9d18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:21.579275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda48d-d0e5-4994-940b-9ae7e0e9d18e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:21.589903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 701/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:22.931800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd139-0af2-411a-8502-af331ed48367 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:22.932406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd139-0af2-411a-8502-af331ed48367 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:22.932406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd139-0af2-411a-8502-af331ed48367 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:22.933632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 694/1395] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:22.939077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8d2a-197c-4cbf-b300-c7e1d52ad761 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:22.939563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8d2a-197c-4cbf-b300-c7e1d52ad761 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:22.939668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8d2a-197c-4cbf-b300-c7e1d52ad761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:22.945902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=52 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:22.959317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f76c8d2a-197c-4cbf-b300-c7e1d52ad761 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:22.960533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f76c8d2a-197c-4cbf-b300-c7e1d52ad761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:22.968553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 702/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:23.026250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0853-83dd-431b-ab6e-aaeadff388cb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.026659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0853-83dd-431b-ab6e-aaeadff388cb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.026925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da0853-83dd-431b-ab6e-aaeadff388cb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.028328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 695/1397] 10.222.0.61 () {54 vars in 962 bytes} [Fri May 27 03:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:23.033666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbbbb4-38a1-466e-aee6-55ac9ce51cf9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.033976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbbbb4-38a1-466e-aee6-55ac9ce51cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.034265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbbbb4-38a1-466e-aee6-55ac9ce51cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.084779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-33cbbbb4-38a1-466e-aee6-55ac9ce51cf9 None None] MFA Rules not processed for user `2f646e6869e44b20adf102b964394512`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:23.085991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-33cbbbb4-38a1-466e-aee6-55ac9ce51cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:23.149090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 703/1398] 10.222.0.61 () {58 vars in 1059 bytes} [Fri May 27 03:16:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:23.157882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0853-83dd-431b-ab6e-aaeadff388cb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:23.169195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da0853-83dd-431b-ab6e-aaeadff388cb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:23.172737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681cbc-7060-4ca5-afff-9931312c9a59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:23.173372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681cbc-7060-4ca5-afff-9931312c9a59 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.173649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681cbc-7060-4ca5-afff-9931312c9a59 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.173918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681cbc-7060-4ca5-afff-9931312c9a59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.183128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681cbc-7060-4ca5-afff-9931312c9a59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:23.184499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681cbc-7060-4ca5-afff-9931312c9a59 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:23.193981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 696/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:16:23.740135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e47b8-0426-4fa5-b56b-f33cc39f2fc6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.740475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e47b8-0426-4fa5-b56b-f33cc39f2fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.740743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e47b8-0426-4fa5-b56b-f33cc39f2fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.794928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-295e47b8-0426-4fa5-b56b-f33cc39f2fc6 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:23.796138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-295e47b8-0426-4fa5-b56b-f33cc39f2fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:23.863537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 704/1400] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:16:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:23.869310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f0bd1-9289-489b-92e1-a803c2188e90 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.869625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f0bd1-9289-489b-92e1-a803c2188e90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.869906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f0bd1-9289-489b-92e1-a803c2188e90 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.871789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 697/1401] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:23.877400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5a7cd-51a9-4127-b27e-9fe2cbae9982 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.877752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5a7cd-51a9-4127-b27e-9fe2cbae9982 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.878069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5a7cd-51a9-4127-b27e-9fe2cbae9982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.897248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e6e5a7cd-51a9-4127-b27e-9fe2cbae9982 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:23.898488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e6e5a7cd-51a9-4127-b27e-9fe2cbae9982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:23.905025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f789d-8397-4c8b-9d09-c86a26ecf900 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.905390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f789d-8397-4c8b-9d09-c86a26ecf900 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.905670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f789d-8397-4c8b-9d09-c86a26ecf900 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.906512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 705/1402] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:23.907497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 698/1403] 10.222.0.61 () {54 vars in 942 bytes} [Fri May 27 03:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:23.914303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348c71-1674-4c2f-a36b-faf8c50b86a4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.914595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348c71-1674-4c2f-a36b-faf8c50b86a4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.914879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348c71-1674-4c2f-a36b-faf8c50b86a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.951824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f789d-8397-4c8b-9d09-c86a26ecf900 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:23.965471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bd348c71-1674-4c2f-a36b-faf8c50b86a4 None None] MFA Rules not processed for user `effdc345daee49d8ad4a09f2dd6fd40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:23.966726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bd348c71-1674-4c2f-a36b-faf8c50b86a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:23.966858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f789d-8397-4c8b-9d09-c86a26ecf900 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:23.972145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:23.972793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:23.973076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:23.973918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:23.975898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:23.982663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:23.984182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:23.993850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 699/1404] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:16:24.041870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 706/1405] 10.222.0.61 () {58 vars in 1039 bytes} [Fri May 27 03:16:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:24.051941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:24.063203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d3f8-cf88-4f4a-9e59-96174c48b2f8 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:24.069592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df59b6-0a4c-4990-90db-a1a50f93e3fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:24.070443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df59b6-0a4c-4990-90db-a1a50f93e3fd service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:24.070726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df59b6-0a4c-4990-90db-a1a50f93e3fd service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:24.071001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df59b6-0a4c-4990-90db-a1a50f93e3fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:24.080350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df59b6-0a4c-4990-90db-a1a50f93e3fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:24.082042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df59b6-0a4c-4990-90db-a1a50f93e3fd service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:24.092534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 700/1406] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:16:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:16:26.325309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc2afa-c1bf-4894-b168-c15fe1c36adf None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:26.325911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc2afa-c1bf-4894-b168-c15fe1c36adf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:26.325911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc2afa-c1bf-4894-b168-c15fe1c36adf None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:26.327247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 707/1407] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:26.336173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ba5ba-7eca-43d7-a1e0-8ae001a5a684 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:26.336741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ba5ba-7eca-43d7-a1e0-8ae001a5a684 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:26.336741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ba5ba-7eca-43d7-a1e0-8ae001a5a684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:26.356458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-887ba5ba-7eca-43d7-a1e0-8ae001a5a684 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:26.357915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-887ba5ba-7eca-43d7-a1e0-8ae001a5a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:26.368957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 701/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:26.413318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc2afa-c1bf-4894-b168-c15fe1c36adf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:26.431188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc2afa-c1bf-4894-b168-c15fe1c36adf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:26.440595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff991a-741f-42d2-bb06-255a6e0f5220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:26.441259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff991a-741f-42d2-bb06-255a6e0f5220 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:26.441545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff991a-741f-42d2-bb06-255a6e0f5220 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:26.442365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff991a-741f-42d2-bb06-255a6e0f5220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:26.452338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff991a-741f-42d2-bb06-255a6e0f5220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:26.453935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff991a-741f-42d2-bb06-255a6e0f5220 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:26.467059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 708/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:36.350696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:36.481586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=33 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:48.294572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab69c-f946-40ee-a279-23141153ef14 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:48.295221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab69c-f946-40ee-a279-23141153ef14 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:48.295221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab69c-f946-40ee-a279-23141153ef14 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:48.296496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 702/1410] 10.222.0.61 () {54 vars in 918 bytes} [Fri May 27 03:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:48.301661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c5ea-23bc-4a09-bb75-ba60729dcc9e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:48.302178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c5ea-23bc-4a09-bb75-ba60729dcc9e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:48.302520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c5ea-23bc-4a09-bb75-ba60729dcc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:48.321292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8025c5ea-23bc-4a09-bb75-ba60729dcc9e None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:48.322687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8025c5ea-23bc-4a09-bb75-ba60729dcc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:48.331443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 709/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Fri May 27 03:16:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:48.347409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267863bc-6d69-4a20-a8e2-17e73ca67951 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:48.348290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267863bc-6d69-4a20-a8e2-17e73ca67951 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:48.348567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267863bc-6d69-4a20-a8e2-17e73ca67951 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:48.349991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 703/1412] 10.222.0.61 () {54 vars in 918 bytes} [Fri May 27 03:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:48.355237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d1bc3-d8a3-4f20-8731-1e2a4303c4de None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:48.355523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d1bc3-d8a3-4f20-8731-1e2a4303c4de None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:48.355801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d1bc3-d8a3-4f20-8731-1e2a4303c4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:48.374175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-032d1bc3-d8a3-4f20-8731-1e2a4303c4de None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:48.375419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-032d1bc3-d8a3-4f20-8731-1e2a4303c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:48.384814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 710/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Fri May 27 03:16:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:51.088310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec94f8-308e-485c-992f-4b1bc776ed02 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:51.088912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec94f8-308e-485c-992f-4b1bc776ed02 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:51.088912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec94f8-308e-485c-992f-4b1bc776ed02 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:51.090275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:51.095641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4373-d138-4407-878b-b86d9efb489a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:51.096062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4373-d138-4407-878b-b86d9efb489a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:51.096181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4373-d138-4407-878b-b86d9efb489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:51.114459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b1bf4373-d138-4407-878b-b86d9efb489a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:51.115670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b1bf4373-d138-4407-878b-b86d9efb489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:51.123558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:51.166926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec94f8-308e-485c-992f-4b1bc776ed02 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:51.181361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec94f8-308e-485c-992f-4b1bc776ed02 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:51.186754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42d122-5e8c-405c-9fc7-b7f5a7891a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:51.187388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d122-5e8c-405c-9fc7-b7f5a7891a89 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:51.187669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d122-5e8c-405c-9fc7-b7f5a7891a89 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:51.187944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42d122-5e8c-405c-9fc7-b7f5a7891a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:51.196009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42d122-5e8c-405c-9fc7-b7f5a7891a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:51.197585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42d122-5e8c-405c-9fc7-b7f5a7891a89 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:51.207319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 705/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:52.193393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51ab42-5212-43db-8f84-8a7ad6648002 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:52.194054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51ab42-5212-43db-8f84-8a7ad6648002 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:52.194054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51ab42-5212-43db-8f84-8a7ad6648002 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:52.195336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:52.200371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b36ab-8c09-454d-8f1d-6f169b7be7da None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:52.200843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b36ab-8c09-454d-8f1d-6f169b7be7da None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:52.200943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b36ab-8c09-454d-8f1d-6f169b7be7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:52.219251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-639b36ab-8c09-454d-8f1d-6f169b7be7da None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:52.220449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-639b36ab-8c09-454d-8f1d-6f169b7be7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:52.228799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:52.391476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51ab42-5212-43db-8f84-8a7ad6648002 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:52.406383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51ab42-5212-43db-8f84-8a7ad6648002 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:52.412288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719f6b7-0334-4ef5-8177-64404bd773b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:52.412930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f6b7-0334-4ef5-8177-64404bd773b5 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:52.413212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f6b7-0334-4ef5-8177-64404bd773b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:52.413486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f6b7-0334-4ef5-8177-64404bd773b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:52.421806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f6b7-0334-4ef5-8177-64404bd773b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:52.423437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f6b7-0334-4ef5-8177-64404bd773b5 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:52.433611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 713/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:53.379643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa7d6b-04e9-4a88-befd-3401ab287432 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:53.380236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa7d6b-04e9-4a88-befd-3401ab287432 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:53.380236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa7d6b-04e9-4a88-befd-3401ab287432 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:53.382130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:53.387781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62047d-b1ca-4a33-be63-7dd31b4cdd42 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:53.388267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62047d-b1ca-4a33-be63-7dd31b4cdd42 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:53.388397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62047d-b1ca-4a33-be63-7dd31b4cdd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:53.406387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-db62047d-b1ca-4a33-be63-7dd31b4cdd42 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:53.407600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-db62047d-b1ca-4a33-be63-7dd31b4cdd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:53.415717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:16:53.577328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa7d6b-04e9-4a88-befd-3401ab287432 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:53.592527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa7d6b-04e9-4a88-befd-3401ab287432 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:53.598606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1012be0-c09f-4afb-a804-fd138c67f92e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:53.599241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1012be0-c09f-4afb-a804-fd138c67f92e service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:53.599523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1012be0-c09f-4afb-a804-fd138c67f92e service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:53.599798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1012be0-c09f-4afb-a804-fd138c67f92e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:53.608080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1012be0-c09f-4afb-a804-fd138c67f92e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:53.609672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1012be0-c09f-4afb-a804-fd138c67f92e service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:53.619256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 708/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:54.557739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57838b-d7ca-4da0-abd1-4dbd8354ec4c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:54.558296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57838b-d7ca-4da0-abd1-4dbd8354ec4c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:54.558296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57838b-d7ca-4da0-abd1-4dbd8354ec4c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:54.559952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:54.565088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5408-b12d-4a50-81ac-434a638f4434 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:54.565530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5408-b12d-4a50-81ac-434a638f4434 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:54.565644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5408-b12d-4a50-81ac-434a638f4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:54.584534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c68e5408-b12d-4a50-81ac-434a638f4434 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:54.585730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c68e5408-b12d-4a50-81ac-434a638f4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:54.593784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:54.742202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57838b-d7ca-4da0-abd1-4dbd8354ec4c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:54.757035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57838b-d7ca-4da0-abd1-4dbd8354ec4c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:54.762630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36168e-b327-481d-ad83-7dc9bf920fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:54.763279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36168e-b327-481d-ad83-7dc9bf920fd3 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:54.763563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36168e-b327-481d-ad83-7dc9bf920fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:54.763837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36168e-b327-481d-ad83-7dc9bf920fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:54.773019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36168e-b327-481d-ad83-7dc9bf920fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:54.774653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36168e-b327-481d-ad83-7dc9bf920fd3 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:54.783948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 716/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:55.707589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b466-3bec-41b7-815b-143fcc7d8211 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.708121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b466-3bec-41b7-815b-143fcc7d8211 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.708121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b466-3bec-41b7-815b-143fcc7d8211 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.709520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:55.715202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a808f86-7dd2-4304-b730-1bcca9b86c3b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.715652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a808f86-7dd2-4304-b730-1bcca9b86c3b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.715748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a808f86-7dd2-4304-b730-1bcca9b86c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.734305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9a808f86-7dd2-4304-b730-1bcca9b86c3b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:55.735512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9a808f86-7dd2-4304-b730-1bcca9b86c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:55.743279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:55.891146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b466-3bec-41b7-815b-143fcc7d8211 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:55.906115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b466-3bec-41b7-815b-143fcc7d8211 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:55.912205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70124d-2039-455b-9aeb-ef0b6e9d2a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:55.912850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70124d-2039-455b-9aeb-ef0b6e9d2a1c service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.913152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70124d-2039-455b-9aeb-ef0b6e9d2a1c service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.913411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70124d-2039-455b-9aeb-ef0b6e9d2a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.921807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70124d-2039-455b-9aeb-ef0b6e9d2a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:55.923418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70124d-2039-455b-9aeb-ef0b6e9d2a1c service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:55.933202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 711/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:56.793255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a360-571e-4ab4-af5a-b041ab70fd8c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:56.793923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a360-571e-4ab4-af5a-b041ab70fd8c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:56.793923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2a360-571e-4ab4-af5a-b041ab70fd8c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:56.795303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:56.800656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94e00b-b670-4ee4-b91d-2c782f554e5a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:56.801127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94e00b-b670-4ee4-b91d-2c782f554e5a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:56.801235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94e00b-b670-4ee4-b91d-2c782f554e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:56.819396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0a94e00b-b670-4ee4-b91d-2c782f554e5a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:56.820582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a94e00b-b670-4ee4-b91d-2c782f554e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:56.828290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:56.981467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2a360-571e-4ab4-af5a-b041ab70fd8c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:56.996395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2a360-571e-4ab4-af5a-b041ab70fd8c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:57.001725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120509d-ab8b-4c39-8785-47859d7d9dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:57.002415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120509d-ab8b-4c39-8785-47859d7d9dfd service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:57.002695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120509d-ab8b-4c39-8785-47859d7d9dfd service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:57.002970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120509d-ab8b-4c39-8785-47859d7d9dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:57.012189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120509d-ab8b-4c39-8785-47859d7d9dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:57.013780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120509d-ab8b-4c39-8785-47859d7d9dfd service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:57.023431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 719/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:16:57.880781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c556a-1b64-48d4-8f99-a29355b9a92c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:57.881361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c556a-1b64-48d4-8f99-a29355b9a92c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:57.881361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c556a-1b64-48d4-8f99-a29355b9a92c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:57.882682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:57.889358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5d11-4312-48c0-9143-cd66bda361f0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:57.889920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5d11-4312-48c0-9143-cd66bda361f0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:57.890343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5d11-4312-48c0-9143-cd66bda361f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:57.917023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e20b5d11-4312-48c0-9143-cd66bda361f0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:57.918259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e20b5d11-4312-48c0-9143-cd66bda361f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:57.926100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:58.073702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c556a-1b64-48d4-8f99-a29355b9a92c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.089051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c556a-1b64-48d4-8f99-a29355b9a92c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.094634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b7e35-f7c7-41e5-bb4a-7dc70029cbfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.095279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7e35-f7c7-41e5-bb4a-7dc70029cbfd service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.095584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7e35-f7c7-41e5-bb4a-7dc70029cbfd service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.095860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7e35-f7c7-41e5-bb4a-7dc70029cbfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.105812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b7e35-f7c7-41e5-bb4a-7dc70029cbfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.107491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b7e35-f7c7-41e5-bb4a-7dc70029cbfd service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.118215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 714/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:16:58.975574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dca13-f715-459a-9ef4-baaf61f03356 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.976141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dca13-f715-459a-9ef4-baaf61f03356 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.976141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dca13-f715-459a-9ef4-baaf61f03356 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.977504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:58.982805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbdde-d06a-4d98-aca5-1a5142f8cfb8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.983243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbdde-d06a-4d98-aca5-1a5142f8cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.983358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbdde-d06a-4d98-aca5-1a5142f8cfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:59.000972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-457fbdde-d06a-4d98-aca5-1a5142f8cfb8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:59.002204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-457fbdde-d06a-4d98-aca5-1a5142f8cfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:59.010551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:16:59.162254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dca13-f715-459a-9ef4-baaf61f03356 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:59.176799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dca13-f715-459a-9ef4-baaf61f03356 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:59.182208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84cbd7-2514-45fe-ab74-578f2f67910f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:59.182856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84cbd7-2514-45fe-ab74-578f2f67910f service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:59.183137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84cbd7-2514-45fe-ab74-578f2f67910f service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:59.183415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84cbd7-2514-45fe-ab74-578f2f67910f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:59.193055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84cbd7-2514-45fe-ab74-578f2f67910f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:59.194722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84cbd7-2514-45fe-ab74-578f2f67910f service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:59.204242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 722/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:00.078254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d6b8b-d2e3-400a-ab57-b489f53b851b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:00.078855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d6b8b-d2e3-400a-ab57-b489f53b851b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:00.078855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d6b8b-d2e3-400a-ab57-b489f53b851b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:00.080453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:00.085577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5addab9-42d4-429c-b1fc-bdd8ce887af5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:00.086056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5addab9-42d4-429c-b1fc-bdd8ce887af5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:00.086156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5addab9-42d4-429c-b1fc-bdd8ce887af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:00.104362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b5addab9-42d4-429c-b1fc-bdd8ce887af5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:00.105582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b5addab9-42d4-429c-b1fc-bdd8ce887af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:00.115064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:00.264480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d6b8b-d2e3-400a-ab57-b489f53b851b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:00.278609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d6b8b-d2e3-400a-ab57-b489f53b851b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:00.284070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3350f7f-1440-4960-bd2d-f5f01c4eb88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:00.284716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350f7f-1440-4960-bd2d-f5f01c4eb88c service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:00.284995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350f7f-1440-4960-bd2d-f5f01c4eb88c service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:00.285271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350f7f-1440-4960-bd2d-f5f01c4eb88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:00.293875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3350f7f-1440-4960-bd2d-f5f01c4eb88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:00.295488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3350f7f-1440-4960-bd2d-f5f01c4eb88c service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:00.305676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 717/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:02.414623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0afea-b9b7-48ff-9f23-70f08284f6f6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.415204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0afea-b9b7-48ff-9f23-70f08284f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.415204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0afea-b9b7-48ff-9f23-70f08284f6f6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.416669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:02.422024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffccd-3252-4982-87a7-9711f7c05f33 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.422461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffccd-3252-4982-87a7-9711f7c05f33 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.422613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffccd-3252-4982-87a7-9711f7c05f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.441396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d8cffccd-3252-4982-87a7-9711f7c05f33 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:02.442685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d8cffccd-3252-4982-87a7-9711f7c05f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:02.453254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:02.493260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0afea-b9b7-48ff-9f23-70f08284f6f6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.504955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0afea-b9b7-48ff-9f23-70f08284f6f6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.508650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0445a65-e724-47ec-bd6d-c42f365e1120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.509298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445a65-e724-47ec-bd6d-c42f365e1120 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.509667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445a65-e724-47ec-bd6d-c42f365e1120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.510011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445a65-e724-47ec-bd6d-c42f365e1120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.519854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0445a65-e724-47ec-bd6d-c42f365e1120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.521317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0445a65-e724-47ec-bd6d-c42f365e1120 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.530746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 725/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:04.883763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a60b-006e-4554-ab80-8c8ae1b22968 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:04.884337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a60b-006e-4554-ab80-8c8ae1b22968 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:04.884337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a60b-006e-4554-ab80-8c8ae1b22968 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:04.885688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:04.890908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827ecf-2081-40d6-9458-8a5a0adc4902 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:04.891383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827ecf-2081-40d6-9458-8a5a0adc4902 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:04.891540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827ecf-2081-40d6-9458-8a5a0adc4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:04.908998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0f827ecf-2081-40d6-9458-8a5a0adc4902 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:04.910260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0f827ecf-2081-40d6-9458-8a5a0adc4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:04.918064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:04.955653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a60b-006e-4554-ab80-8c8ae1b22968 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:04.966646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a60b-006e-4554-ab80-8c8ae1b22968 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:04.970064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98632f6-0cd0-49b2-b698-adc65cd615f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:04.970698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98632f6-0cd0-49b2-b698-adc65cd615f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:04.970974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98632f6-0cd0-49b2-b698-adc65cd615f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:04.971245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98632f6-0cd0-49b2-b698-adc65cd615f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:04.980425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98632f6-0cd0-49b2-b698-adc65cd615f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:04.981848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98632f6-0cd0-49b2-b698-adc65cd615f4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:04.991683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 720/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:07.578851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107c8d-be7a-40c1-b46a-0ee72181f3e8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:07.579396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107c8d-be7a-40c1-b46a-0ee72181f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:07.579396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107c8d-be7a-40c1-b46a-0ee72181f3e8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:07.580768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:07.586466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e906ba-16cd-4ae3-89fd-22f8baa1c3e5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:07.587178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e906ba-16cd-4ae3-89fd-22f8baa1c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:07.587178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e906ba-16cd-4ae3-89fd-22f8baa1c3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:07.608071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-49e906ba-16cd-4ae3-89fd-22f8baa1c3e5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:07.609259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-49e906ba-16cd-4ae3-89fd-22f8baa1c3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:07.617612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:17:07.656405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107c8d-be7a-40c1-b46a-0ee72181f3e8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:07.658191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2107c8d-be7a-40c1-b46a-0ee72181f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:07.671142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107c8d-be7a-40c1-b46a-0ee72181f3e8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:07.675923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b3a47-8b2a-4d79-b43b-f803fa115cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:07.676628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b3a47-8b2a-4d79-b43b-f803fa115cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:07.676909 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b3a47-8b2a-4d79-b43b-f803fa115cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:07.677183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b3a47-8b2a-4d79-b43b-f803fa115cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:07.693618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b3a47-8b2a-4d79-b43b-f803fa115cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:07.695270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b3a47-8b2a-4d79-b43b-f803fa115cf9 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:07.705819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 728/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:10.048711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008bf53-c844-41c2-ad21-6d3d30395715 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:10.049392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008bf53-c844-41c2-ad21-6d3d30395715 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:10.049392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008bf53-c844-41c2-ad21-6d3d30395715 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:10.050709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:10.059810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6420f8-1217-4eac-84f1-f4daa90b04ba None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:10.060421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6420f8-1217-4eac-84f1-f4daa90b04ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:10.060421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6420f8-1217-4eac-84f1-f4daa90b04ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:10.078425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3b6420f8-1217-4eac-84f1-f4daa90b04ba None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:10.079651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3b6420f8-1217-4eac-84f1-f4daa90b04ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:10.088565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:17:10.127023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008bf53-c844-41c2-ad21-6d3d30395715 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:10.138081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008bf53-c844-41c2-ad21-6d3d30395715 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:10.141704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ccf9-f340-4402-9cd1-325e6b0c90a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:10.142375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ccf9-f340-4402-9cd1-325e6b0c90a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:10.142685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ccf9-f340-4402-9cd1-325e6b0c90a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:10.142953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ccf9-f340-4402-9cd1-325e6b0c90a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:10.152473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5ccf9-f340-4402-9cd1-325e6b0c90a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:10.153903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5ccf9-f340-4402-9cd1-325e6b0c90a7 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:10.164013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 723/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:12.488852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b74f0-456d-4106-b352-3492f911e786 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:12.489426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b74f0-456d-4106-b352-3492f911e786 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:12.489426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b74f0-456d-4106-b352-3492f911e786 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:12.490850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:12.496456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc81e29-d876-4275-8ed0-a12e0abd3520 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:12.496869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc81e29-d876-4275-8ed0-a12e0abd3520 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:12.497055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc81e29-d876-4275-8ed0-a12e0abd3520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:12.515083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-edc81e29-d876-4275-8ed0-a12e0abd3520 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:12.516199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-edc81e29-d876-4275-8ed0-a12e0abd3520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:12.524656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:12.561511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b74f0-456d-4106-b352-3492f911e786 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:12.572891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b74f0-456d-4106-b352-3492f911e786 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:12.576448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcbfe3-4466-43fb-9c93-3e6a35a8338d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:12.577088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcbfe3-4466-43fb-9c93-3e6a35a8338d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:12.577370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcbfe3-4466-43fb-9c93-3e6a35a8338d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:12.577646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcbfe3-4466-43fb-9c93-3e6a35a8338d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:12.587294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcbfe3-4466-43fb-9c93-3e6a35a8338d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:12.589011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcbfe3-4466-43fb-9c93-3e6a35a8338d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:12.598266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 731/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:14.845500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a81b-87d8-4cc7-8b5b-344ef1903b17 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.846107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a81b-87d8-4cc7-8b5b-344ef1903b17 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.846107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a81b-87d8-4cc7-8b5b-344ef1903b17 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.848006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:14.853417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63cc4d-117f-4a7e-a928-eceffb612c08 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.853998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63cc4d-117f-4a7e-a928-eceffb612c08 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.853998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63cc4d-117f-4a7e-a928-eceffb612c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.872387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9f63cc4d-117f-4a7e-a928-eceffb612c08 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:14.873599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9f63cc4d-117f-4a7e-a928-eceffb612c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:14.881518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:14.918650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a81b-87d8-4cc7-8b5b-344ef1903b17 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.929894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a81b-87d8-4cc7-8b5b-344ef1903b17 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.933367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9b53f-d3db-4128-87db-b802840624e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.934021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b53f-d3db-4128-87db-b802840624e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.934303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b53f-d3db-4128-87db-b802840624e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.934573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9b53f-d3db-4128-87db-b802840624e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.943162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9b53f-d3db-4128-87db-b802840624e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.944590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9b53f-d3db-4128-87db-b802840624e2 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.954137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 726/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:17.277883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e609ba-0c97-4115-9c0d-609386d8117d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.278521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e609ba-0c97-4115-9c0d-609386d8117d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.278521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e609ba-0c97-4115-9c0d-609386d8117d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.279899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:17.286086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b709bc-bcc8-4072-80d2-449d440dda71 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.286536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b709bc-bcc8-4072-80d2-449d440dda71 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.286661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b709bc-bcc8-4072-80d2-449d440dda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.292620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=70 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:17.305863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a8b709bc-bcc8-4072-80d2-449d440dda71 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:17.307110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a8b709bc-bcc8-4072-80d2-449d440dda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:17.314953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:17.353317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e609ba-0c97-4115-9c0d-609386d8117d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:17.358760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=73 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:17.365019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e609ba-0c97-4115-9c0d-609386d8117d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:17.368534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53aad9-1210-49f8-9fb9-82605fd68b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:17.369176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53aad9-1210-49f8-9fb9-82605fd68b85 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.369462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53aad9-1210-49f8-9fb9-82605fd68b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.369741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53aad9-1210-49f8-9fb9-82605fd68b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.379172 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53aad9-1210-49f8-9fb9-82605fd68b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:17.380616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53aad9-1210-49f8-9fb9-82605fd68b85 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:17.390391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 734/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:19.699187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3ab6-ccb2-4733-8d7d-3f581cb99155 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.699775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3ab6-ccb2-4733-8d7d-3f581cb99155 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.699775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3ab6-ccb2-4733-8d7d-3f581cb99155 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.701134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:19.706632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790852e-3fb4-4545-8234-bd156c9d3535 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.707079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790852e-3fb4-4545-8234-bd156c9d3535 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.707240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790852e-3fb4-4545-8234-bd156c9d3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.725363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0790852e-3fb4-4545-8234-bd156c9d3535 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:19.726629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0790852e-3fb4-4545-8234-bd156c9d3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:19.734599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:17:19.772619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c3ab6-ccb2-4733-8d7d-3f581cb99155 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:19.783123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c3ab6-ccb2-4733-8d7d-3f581cb99155 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:19.786576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb1b6e-e870-4260-b7d1-4933ad741d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:19.787200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1b6e-e870-4260-b7d1-4933ad741d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.787483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1b6e-e870-4260-b7d1-4933ad741d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.787748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1b6e-e870-4260-b7d1-4933ad741d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.796523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb1b6e-e870-4260-b7d1-4933ad741d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:19.797937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb1b6e-e870-4260-b7d1-4933ad741d14 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:19.807826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 729/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:22.064849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02f3f-c2f6-4427-8302-a51b55e67486 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.065447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02f3f-c2f6-4427-8302-a51b55e67486 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.065447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02f3f-c2f6-4427-8302-a51b55e67486 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.066944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:22.072540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bcf8f-8284-419a-b09a-38e1d4703838 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.073016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bcf8f-8284-419a-b09a-38e1d4703838 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.073115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bcf8f-8284-419a-b09a-38e1d4703838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.091859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bb8bcf8f-8284-419a-b09a-38e1d4703838 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:22.093076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bb8bcf8f-8284-419a-b09a-38e1d4703838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:22.101639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:22.138525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02f3f-c2f6-4427-8302-a51b55e67486 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.151905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02f3f-c2f6-4427-8302-a51b55e67486 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.157295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5c26-f482-4807-b56c-575d04d92a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.158337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5c26-f482-4807-b56c-575d04d92a40 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.158783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5c26-f482-4807-b56c-575d04d92a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.159798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5c26-f482-4807-b56c-575d04d92a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.174709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5c26-f482-4807-b56c-575d04d92a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:22.177303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5c26-f482-4807-b56c-575d04d92a40 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:22.194393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 737/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:24.433938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f0ef-d891-4042-822c-ed51386e6dcb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.434533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f0ef-d891-4042-822c-ed51386e6dcb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.434533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42f0ef-d891-4042-822c-ed51386e6dcb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.435899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:24.442048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525e7a-a291-4d5d-8d83-8e88bcbd6038 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.442500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525e7a-a291-4d5d-8d83-8e88bcbd6038 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.442615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525e7a-a291-4d5d-8d83-8e88bcbd6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.460717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1f525e7a-a291-4d5d-8d83-8e88bcbd6038 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:24.461921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1f525e7a-a291-4d5d-8d83-8e88bcbd6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:24.470009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:24.506566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f0ef-d891-4042-822c-ed51386e6dcb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.517573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42f0ef-d891-4042-822c-ed51386e6dcb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.521663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e002c-7374-4d61-a8fd-aa6ba13b0613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.522345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e002c-7374-4d61-a8fd-aa6ba13b0613 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.522629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e002c-7374-4d61-a8fd-aa6ba13b0613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.522902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e002c-7374-4d61-a8fd-aa6ba13b0613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.532181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e002c-7374-4d61-a8fd-aa6ba13b0613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:24.533618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e002c-7374-4d61-a8fd-aa6ba13b0613 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:24.543426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 732/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:17:34.454866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=17 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:34.539254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=17 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:57.607798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfec0c-a093-4c98-bd66-d9db734efafc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.608401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfec0c-a093-4c98-bd66-d9db734efafc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.608401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfec0c-a093-4c98-bd66-d9db734efafc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.609779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 739/1471] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:57.615078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b5cc1-3bdd-4f8e-8c21-45b5c6597799 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.615499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b5cc1-3bdd-4f8e-8c21-45b5c6597799 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.615628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b5cc1-3bdd-4f8e-8c21-45b5c6597799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.633330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e94b5cc1-3bdd-4f8e-8c21-45b5c6597799 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:57.634535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e94b5cc1-3bdd-4f8e-8c21-45b5c6597799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:57.642766 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 733/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:57.691716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be51b8-4726-4169-8a5f-d3cbc38513bd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.692024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be51b8-4726-4169-8a5f-d3cbc38513bd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.692308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be51b8-4726-4169-8a5f-d3cbc38513bd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.693835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 740/1473] 10.222.0.61 () {54 vars in 962 bytes} [Fri May 27 03:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:57.698562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077787f-73d0-4331-88a3-ccae723da596 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.698847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077787f-73d0-4331-88a3-ccae723da596 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.699123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077787f-73d0-4331-88a3-ccae723da596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.717828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d077787f-73d0-4331-88a3-ccae723da596 None None] MFA Rules not processed for user `2f646e6869e44b20adf102b964394512`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:57.719044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d077787f-73d0-4331-88a3-ccae723da596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:57.725520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 734/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Fri May 27 03:17:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:17:57.733014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be51b8-4726-4169-8a5f-d3cbc38513bd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.743916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be51b8-4726-4169-8a5f-d3cbc38513bd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.747344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739b9b1-3515-4f23-b579-1a0cb4c6224c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.747978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b9b1-3515-4f23-b579-1a0cb4c6224c service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.748261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b9b1-3515-4f23-b579-1a0cb4c6224c service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.748534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b9b1-3515-4f23-b579-1a0cb4c6224c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.757823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b9b1-3515-4f23-b579-1a0cb4c6224c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:57.759291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b9b1-3515-4f23-b579-1a0cb4c6224c service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:57.769323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 741/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:18:00.085030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108773-f47b-4580-96a4-4cb0258ad665 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.085604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108773-f47b-4580-96a4-4cb0258ad665 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.085604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108773-f47b-4580-96a4-4cb0258ad665 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.086993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 735/1476] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:00.092466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f7a9-34e8-4cdb-987d-c16d3eacba09 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.092926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f7a9-34e8-4cdb-987d-c16d3eacba09 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.093035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f7a9-34e8-4cdb-987d-c16d3eacba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.112014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-afa6f7a9-34e8-4cdb-987d-c16d3eacba09 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:00.113212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-afa6f7a9-34e8-4cdb-987d-c16d3eacba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:00.121008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 742/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:18:00.144995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108773-f47b-4580-96a4-4cb0258ad665 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.157351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108773-f47b-4580-96a4-4cb0258ad665 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:00.161767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:00.162474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.162756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.163033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.163756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:00.165545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:18:00.165545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:18:00.165545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:18:00.166751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb691f-2adc-4ed3-b6ba-09fc74a8f9d1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:00.185987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 736/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Fri May 27 03:18:00 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:18:02.458127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bca0a-02d9-4567-ac93-a77947f37d92 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.458648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bca0a-02d9-4567-ac93-a77947f37d92 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.458773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bca0a-02d9-4567-ac93-a77947f37d92 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.460232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 743/1479] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:02.466013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834154-5159-4eb0-8b4d-8e56370c6d31 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.466535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834154-5159-4eb0-8b4d-8e56370c6d31 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.466535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834154-5159-4eb0-8b4d-8e56370c6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.484447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-66834154-5159-4eb0-8b4d-8e56370c6d31 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:02.486411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-66834154-5159-4eb0-8b4d-8e56370c6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:02.494418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 737/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:18:02.539228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bca0a-02d9-4567-ac93-a77947f37d92 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.554884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bca0a-02d9-4567-ac93-a77947f37d92 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:02.560186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410811e2-eaee-419b-b415-96a248b3ad7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:02.561081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410811e2-eaee-419b-b415-96a248b3ad7d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.561369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410811e2-eaee-419b-b415-96a248b3ad7d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.561649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410811e2-eaee-419b-b415-96a248b3ad7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.570459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410811e2-eaee-419b-b415-96a248b3ad7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:02.572040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410811e2-eaee-419b-b415-96a248b3ad7d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:02.581298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 744/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:18:04.983222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd8af-dc48-43e7-8627-0e98f4dd23f4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:04.983798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd8af-dc48-43e7-8627-0e98f4dd23f4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:04.983798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd8af-dc48-43e7-8627-0e98f4dd23f4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:04.985143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 738/1482] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:04.991036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99eba6-adec-42b2-96c3-d1306d4d4530 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:04.991455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99eba6-adec-42b2-96c3-d1306d4d4530 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:04.991614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99eba6-adec-42b2-96c3-d1306d4d4530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:05.008995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-be99eba6-adec-42b2-96c3-d1306d4d4530 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:05.010227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-be99eba6-adec-42b2-96c3-d1306d4d4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:05.019430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 745/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:18:05.056016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd8af-dc48-43e7-8627-0e98f4dd23f4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:05.066874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd8af-dc48-43e7-8627-0e98f4dd23f4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:05.070470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050d1f9-f0f5-41a0-a2c4-d4f6beb01ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:05.071115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050d1f9-f0f5-41a0-a2c4-d4f6beb01ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:05.071398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050d1f9-f0f5-41a0-a2c4-d4f6beb01ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:05.071674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050d1f9-f0f5-41a0-a2c4-d4f6beb01ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:05.080721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050d1f9-f0f5-41a0-a2c4-d4f6beb01ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:05.082200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050d1f9-f0f5-41a0-a2c4-d4f6beb01ef6 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:05.092000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 739/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:18:07.331223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb4367-87f9-4428-bfef-5dc55f538af3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.331768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb4367-87f9-4428-bfef-5dc55f538af3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.331768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb4367-87f9-4428-bfef-5dc55f538af3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.333165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 746/1485] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:07.338577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6447677-3f71-434b-a6a0-f18886b2805d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.338993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6447677-3f71-434b-a6a0-f18886b2805d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.339124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6447677-3f71-434b-a6a0-f18886b2805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.356556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d6447677-3f71-434b-a6a0-f18886b2805d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:07.357729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d6447677-3f71-434b-a6a0-f18886b2805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:07.365470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 740/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:18:07.402870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb4367-87f9-4428-bfef-5dc55f538af3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:07.413527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb4367-87f9-4428-bfef-5dc55f538af3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:07.417050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3ad0b-c15d-4f53-85f1-1c4153d14458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:07.417667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3ad0b-c15d-4f53-85f1-1c4153d14458 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.417949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3ad0b-c15d-4f53-85f1-1c4153d14458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.418709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3ad0b-c15d-4f53-85f1-1c4153d14458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.427173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3ad0b-c15d-4f53-85f1-1c4153d14458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:07.428588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3ad0b-c15d-4f53-85f1-1c4153d14458 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:07.437774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 747/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:18:09.820785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fe450-e7e3-4a98-bb65-ddf2f377d84b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.821365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fe450-e7e3-4a98-bb65-ddf2f377d84b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.821365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fe450-e7e3-4a98-bb65-ddf2f377d84b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.822775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 741/1488] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:09.827974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d49a3-4614-4486-9fec-28697749cee2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.828436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d49a3-4614-4486-9fec-28697749cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.828552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d49a3-4614-4486-9fec-28697749cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.846555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a88d49a3-4614-4486-9fec-28697749cee2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:09.847756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a88d49a3-4614-4486-9fec-28697749cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:09.855546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 748/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:18:09.895941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fe450-e7e3-4a98-bb65-ddf2f377d84b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:09.906543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fe450-e7e3-4a98-bb65-ddf2f377d84b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:09.910125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f405f-0b62-437f-8e34-924b997d2523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:09.910762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f405f-0b62-437f-8e34-924b997d2523 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.911046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f405f-0b62-437f-8e34-924b997d2523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.911323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f405f-0b62-437f-8e34-924b997d2523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.920040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f405f-0b62-437f-8e34-924b997d2523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:09.921472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f405f-0b62-437f-8e34-924b997d2523 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:09.931343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 742/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:18:12.330043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f52eb-dd57-407c-9aaa-444c9b2f77d1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.330562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f52eb-dd57-407c-9aaa-444c9b2f77d1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.330666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f52eb-dd57-407c-9aaa-444c9b2f77d1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.331975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 749/1491] 10.222.0.61 () {54 vars in 926 bytes} [Fri May 27 03:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:12.337241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b01a3-abe7-4bcd-b303-2e30488d6b56 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.337698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b01a3-abe7-4bcd-b303-2e30488d6b56 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.338100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b01a3-abe7-4bcd-b303-2e30488d6b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.356146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-609b01a3-abe7-4bcd-b303-2e30488d6b56 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:12.357321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-609b01a3-abe7-4bcd-b303-2e30488d6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:12.364982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 743/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Fri May 27 03:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:18:12.402914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f52eb-dd57-407c-9aaa-444c9b2f77d1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.414088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f52eb-dd57-407c-9aaa-444c9b2f77d1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.417539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd9f2e-4d4d-47f7-9bde-4576faa4bc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.418277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd9f2e-4d4d-47f7-9bde-4576faa4bc42 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.418560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd9f2e-4d4d-47f7-9bde-4576faa4bc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.418834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd9f2e-4d4d-47f7-9bde-4576faa4bc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.427691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd9f2e-4d4d-47f7-9bde-4576faa4bc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.429114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd9f2e-4d4d-47f7-9bde-4576faa4bc42 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.438880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 750/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:18:22.351082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=33 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:22.434319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=33 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:53.736096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:53.736685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:53.736685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:53.754690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:53.755896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:53.764047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 744/1494] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:19:53.773121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:53.773749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:53.773749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:53.791847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:53.793038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:53.801358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 751/1495] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:19:53.805818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:53.815533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c56e2-c6ca-4d44-a1ba-695476b7ba10 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:53.819993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:53.820648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:53.820933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:53.821213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:53.821924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:53.822267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:53.823298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:53.823298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:19:53.823298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:19:53.824162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:53.835783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 745/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:53.844668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:53.853584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc7a3-875c-4de6-a76f-d76eb28892d0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:53.858729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:53.859372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:53.859653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:53.859935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:53.860620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:53.862402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:53.862402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:19:53.862402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:19:53.863586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:53.898788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 752/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:19:53 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:53.904040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:53.913989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6c6c-260e-46d6-b0b5-7ff3aea9bca6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:53.969937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:53.970639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:53.970923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:53.971200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:53.971893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:53.973038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:53.973038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:19:53.973038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:19:53.974287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:53.993564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 746/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:19:53 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:53.997716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.007684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05063cd7-b804-4ba5-933f-ce00cbfab7b2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.012119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.012799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.013077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.013348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.014099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.015106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:54.015106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:19:54.015106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:19:54.015989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.029497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 753/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:19:54.033320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.043874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01a0d3-edb0-422d-b365-41e5a31961b0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.048663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.049348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.049647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.049923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.050685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.051706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:54.051706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:19:54.051706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:19:54.052601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d74ab-eff0-4a11-aa0b-97b3c6d686e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.067141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 747/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:19:54.071423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.082488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed0534-2958-44e3-9bfe-12a248b2606d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.087431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.088319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.088607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.088885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] PATH_INFO: `/v3/projects/28676b94638541ffb2ab9b3652d32b69/users/4322d559b5e8471d8670fcec7c702512/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.105371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28676b94638541ffb2ab9b3652d32b69, user_id=4322d559b5e8471d8670fcec7c702512, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.106471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:54.106471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:19:54.106471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:19:54.108450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7df57a-0371-4e07-88b8-10289a10664d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.122255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 754/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:19:54 2022] PUT /identity/v3/projects/28676b94638541ffb2ab9b3652d32b69/users/4322d559b5e8471d8670fcec7c702512/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:19:54.133551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04394f-0756-4914-9480-3c4689398633 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.133841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04394f-0756-4914-9480-3c4689398633 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.134153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04394f-0756-4914-9480-3c4689398633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.160730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ac04394f-0756-4914-9480-3c4689398633 None None] MFA Rules not processed for user `4322d559b5e8471d8670fcec7c702512`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:54.161942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac04394f-0756-4914-9480-3c4689398633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:54.224432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 748/1502] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:19:54.237548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4e57-2960-478d-b80d-a8738768b702 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.237872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4e57-2960-478d-b80d-a8738768b702 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.238192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4e57-2960-478d-b80d-a8738768b702 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.239557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 755/1503] 10.222.0.61 () {54 vars in 963 bytes} [Fri May 27 03:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:54.244617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c698e-78a9-45c7-85cf-8f2d457b292b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.244965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c698e-78a9-45c7-85cf-8f2d457b292b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.245349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c698e-78a9-45c7-85cf-8f2d457b292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.268062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-376c698e-78a9-45c7-85cf-8f2d457b292b None None] MFA Rules not processed for user `b8bc75da330c48aab2b15609eb495cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:54.269298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-376c698e-78a9-45c7-85cf-8f2d457b292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:54.312335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:54.322290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 749/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Fri May 27 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:19:54.330582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4e57-2960-478d-b80d-a8738768b702 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.342045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4e57-2960-478d-b80d-a8738768b702 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.345768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.346435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.346713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.346981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.355148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.356556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.365346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 756/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:19:54.407101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951eb6-a09d-40c6-b1b1-59a005d2d312 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.407392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951eb6-a09d-40c6-b1b1-59a005d2d312 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.407671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951eb6-a09d-40c6-b1b1-59a005d2d312 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.408980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 750/1506] 10.222.0.61 () {52 vars in 829 bytes} [Fri May 27 03:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:54.412721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.475592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723eabb-d3ef-4cb5-a654-6aa8a5202250 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.480102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.481616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.481926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.482235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] PATH_INFO: `/v3/users/4322d559b5e8471d8670fcec7c702512` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.483433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4322d559b5e8471d8670fcec7c702512)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.484464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:54.484464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:19:54.484464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:19:54.485726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.554767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4322d559b5e8471d8670fcec7c702512'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:54.555327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4322d559b5e8471d8670fcec7c702512'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:54.568689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4322d559b5e8471d8670fcec7c702512'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:54.579285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4322d559b5e8471d8670fcec7c702512'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:54.596231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:54.599566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4322d559b5e8471d8670fcec7c702512'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:54.607241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 757/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:19:54 2022] DELETE /identity/v3/users/4322d559b5e8471d8670fcec7c702512 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:19:54.611767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.612048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.612321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.629956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:54.631176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:54.689367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 751/1508] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:19:54.700153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.701559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:54.758835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb12dc-8f62-4be0-9d54-ba9442316331 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.762974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced8cdb-4566-4b31-b0cc-81a43bfc678a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.763619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8cdb-4566-4b31-b0cc-81a43bfc678a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.763902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8cdb-4566-4b31-b0cc-81a43bfc678a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.764178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8cdb-4566-4b31-b0cc-81a43bfc678a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.773050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced8cdb-4566-4b31-b0cc-81a43bfc678a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.774525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced8cdb-4566-4b31-b0cc-81a43bfc678a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.783861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 758/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:19:55.145141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:55.146667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:55.158968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8b0d6-f057-44ce-b42b-652ea0176dfe None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:55.163777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:55.164676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:55.164954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:55.165259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] PATH_INFO: `/v3/projects/28676b94638541ffb2ab9b3652d32b69` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:55.166531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=28676b94638541ffb2ab9b3652d32b69)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:55.167556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:19:55.167556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:19:55.167556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:19:55.169424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:55.228834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28676b94638541ffb2ab9b3652d32b69', 'request_id': 'req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:55.235878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28676b94638541ffb2ab9b3652d32b69', 'request_id': 'req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:55.249706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28676b94638541ffb2ab9b3652d32b69', 'request_id': 'req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:55.264236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] The token cache is being invalidate because project 28676b94638541ffb2ab9b3652d32b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:19:55.264520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:55.265153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9defe1cf-ad16-4616-8bd6-0d4b7f70fdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:19:55.266935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 752/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:19:55 2022] DELETE /identity/v3/projects/28676b94638541ffb2ab9b3652d32b69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:20:04.779666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:05.260980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:43.502362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d000-b87a-4bdd-99ba-a732d5a99d98 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:43.502903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d000-b87a-4bdd-99ba-a732d5a99d98 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:43.502903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d000-b87a-4bdd-99ba-a732d5a99d98 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:43.504280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:43.509745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2f148-05f2-446e-81a4-e7cdbec9ca85 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:43.510235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2f148-05f2-446e-81a4-e7cdbec9ca85 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:43.510345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2f148-05f2-446e-81a4-e7cdbec9ca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:43.528998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dfa2f148-05f2-446e-81a4-e7cdbec9ca85 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:43.530233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dfa2f148-05f2-446e-81a4-e7cdbec9ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:43.594155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:21:43.767933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588d000-b87a-4bdd-99ba-a732d5a99d98 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:43.769645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4588d000-b87a-4bdd-99ba-a732d5a99d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:43.843540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588d000-b87a-4bdd-99ba-a732d5a99d98 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:43.848855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebd43d-f149-4ec7-9ca4-66df5693e8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:43.849496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd43d-f149-4ec7-9ca4-66df5693e8ea service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:43.849776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd43d-f149-4ec7-9ca4-66df5693e8ea service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:43.850083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd43d-f149-4ec7-9ca4-66df5693e8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:43.858061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebd43d-f149-4ec7-9ca4-66df5693e8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:43.859649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebd43d-f149-4ec7-9ca4-66df5693e8ea service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:43.869046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 760/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:21:44.758260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adcecb-a8b7-4259-98e2-5eed10d25f50 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:44.759022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adcecb-a8b7-4259-98e2-5eed10d25f50 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:44.759022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adcecb-a8b7-4259-98e2-5eed10d25f50 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:44.760306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:44.765376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0066ce-56e8-4d76-99c6-dfaca3a1babd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:44.765849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0066ce-56e8-4d76-99c6-dfaca3a1babd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:44.766024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0066ce-56e8-4d76-99c6-dfaca3a1babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:44.784889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ae0066ce-56e8-4d76-99c6-dfaca3a1babd None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:44.786133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ae0066ce-56e8-4d76-99c6-dfaca3a1babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:44.794831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:21:44.949522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adcecb-a8b7-4259-98e2-5eed10d25f50 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:44.964884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adcecb-a8b7-4259-98e2-5eed10d25f50 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:44.970365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d6839-f36f-409f-af34-c019de69e3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:44.971012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d6839-f36f-409f-af34-c019de69e3e5 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:44.971314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d6839-f36f-409f-af34-c019de69e3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:44.971567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d6839-f36f-409f-af34-c019de69e3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:44.981760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d6839-f36f-409f-af34-c019de69e3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:44.983415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d6839-f36f-409f-af34-c019de69e3e5 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:44.993365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 755/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:21:45.128133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362e9ab-3ad3-4f8a-84a9-74fc540bafb5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.128470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362e9ab-3ad3-4f8a-84a9-74fc540bafb5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.128751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362e9ab-3ad3-4f8a-84a9-74fc540bafb5 None None] PATH_INFO: `/v3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.130834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 762/1517] 10.222.0.53 () {54 vars in 925 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:45.137623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3488-4f9a-4c18-975d-57d8b475e64a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.137915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3488-4f9a-4c18-975d-57d8b475e64a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.138263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3488-4f9a-4c18-975d-57d8b475e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.158821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e74b3488-4f9a-4c18-975d-57d8b475e64a None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:45.160042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e74b3488-4f9a-4c18-975d-57d8b475e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:45.221798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 756/1518] 10.222.0.53 () {58 vars in 1015 bytes} [Fri May 27 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:21:49.199906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8e86-5520-4be3-8b1a-2d55349e8c8b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.200451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8e86-5520-4be3-8b1a-2d55349e8c8b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.200451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8e86-5520-4be3-8b1a-2d55349e8c8b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.201754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 763/1519] 10.222.0.61 () {54 vars in 960 bytes} [Fri May 27 03:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:49.206586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828a97-fafd-4dc8-afd3-d7a590a78811 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.207005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828a97-fafd-4dc8-afd3-d7a590a78811 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.207137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828a97-fafd-4dc8-afd3-d7a590a78811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.225358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fe828a97-fafd-4dc8-afd3-d7a590a78811 None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:49.227116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe828a97-fafd-4dc8-afd3-d7a590a78811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:49.235367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 757/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Fri May 27 03:21:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:21:49.242668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b8e86-5520-4be3-8b1a-2d55349e8c8b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:49.256420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b8e86-5520-4be3-8b1a-2d55349e8c8b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:49.261830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddbb10-9ac1-493b-b3b3-414456e476b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:49.262512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddbb10-9ac1-493b-b3b3-414456e476b8 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.262821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddbb10-9ac1-493b-b3b3-414456e476b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.263100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddbb10-9ac1-493b-b3b3-414456e476b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.271689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddbb10-9ac1-493b-b3b3-414456e476b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:49.273829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddbb10-9ac1-493b-b3b3-414456e476b8 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:49.286576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 764/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:21:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:21:56.290641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb808f2-26e3-49fb-92d4-17e10cd80b6d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:56.291219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb808f2-26e3-49fb-92d4-17e10cd80b6d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:56.291219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb808f2-26e3-49fb-92d4-17e10cd80b6d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:56.292595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:56.297508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1f7b1-6ed6-4fec-8ace-59444fd39221 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:56.297981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1f7b1-6ed6-4fec-8ace-59444fd39221 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:56.298094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1f7b1-6ed6-4fec-8ace-59444fd39221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:56.316534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-edf1f7b1-6ed6-4fec-8ace-59444fd39221 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:56.317762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-edf1f7b1-6ed6-4fec-8ace-59444fd39221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:56.325529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:21:56.478181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb808f2-26e3-49fb-92d4-17e10cd80b6d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:56.493130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb808f2-26e3-49fb-92d4-17e10cd80b6d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:56.498579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587c09f-b2f2-4641-97b0-8ca2cf51a114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:56.499221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c09f-b2f2-4641-97b0-8ca2cf51a114 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:56.499500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c09f-b2f2-4641-97b0-8ca2cf51a114 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:56.499772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c09f-b2f2-4641-97b0-8ca2cf51a114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:56.508184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c09f-b2f2-4641-97b0-8ca2cf51a114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:56.509773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587c09f-b2f2-4641-97b0-8ca2cf51a114 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:56.519310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 759/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:21:57.389986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8e54-da7e-4a4e-b2d8-70304113b48d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:57.390558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8e54-da7e-4a4e-b2d8-70304113b48d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:57.390558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8e54-da7e-4a4e-b2d8-70304113b48d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:57.391912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:57.396664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a79d71-732c-434f-a3c3-f491efab0aa8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:57.397116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a79d71-732c-434f-a3c3-f491efab0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:57.397232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a79d71-732c-434f-a3c3-f491efab0aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:57.415612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f2a79d71-732c-434f-a3c3-f491efab0aa8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:57.416729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f2a79d71-732c-434f-a3c3-f491efab0aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:57.424659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:21:57.585937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8e54-da7e-4a4e-b2d8-70304113b48d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:57.600257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8e54-da7e-4a4e-b2d8-70304113b48d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:57.605663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df335d81-298b-49b6-ac21-2bb2560a459a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:57.606339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335d81-298b-49b6-ac21-2bb2560a459a service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:57.606625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335d81-298b-49b6-ac21-2bb2560a459a service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:57.606906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df335d81-298b-49b6-ac21-2bb2560a459a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:57.615090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df335d81-298b-49b6-ac21-2bb2560a459a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:57.617218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df335d81-298b-49b6-ac21-2bb2560a459a service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:57.626635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 767/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:22:01.895416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9eb6-1dec-4ec3-9b51-a55681c10a79 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:01.895933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9eb6-1dec-4ec3-9b51-a55681c10a79 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:01.895933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9eb6-1dec-4ec3-9b51-a55681c10a79 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:01.897260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:01.903094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40badb8e-2b66-42b4-a366-0e1607cb2d35 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:01.903515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40badb8e-2b66-42b4-a366-0e1607cb2d35 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:01.903686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40badb8e-2b66-42b4-a366-0e1607cb2d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:01.921994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-40badb8e-2b66-42b4-a366-0e1607cb2d35 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:01.923199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-40badb8e-2b66-42b4-a366-0e1607cb2d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:01.931007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:22:01.967132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9eb6-1dec-4ec3-9b51-a55681c10a79 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:01.968786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-128f9eb6-1dec-4ec3-9b51-a55681c10a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:02.024562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9eb6-1dec-4ec3-9b51-a55681c10a79 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:02.028066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6084553-e38b-4444-b19a-2e454ccffce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:02.028694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084553-e38b-4444-b19a-2e454ccffce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.028969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084553-e38b-4444-b19a-2e454ccffce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.029243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6084553-e38b-4444-b19a-2e454ccffce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.038146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6084553-e38b-4444-b19a-2e454ccffce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:02.039582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6084553-e38b-4444-b19a-2e454ccffce2 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:02.045086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:02.050673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 762/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:22:04.277207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62624-f998-463e-84c5-507f550f02ae None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:04.277780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62624-f998-463e-84c5-507f550f02ae None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:04.277780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b62624-f998-463e-84c5-507f550f02ae None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:04.279193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:04.284486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24212bf4-8cfe-4bd4-b5f1-bbbb28cdbb74 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:04.284877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24212bf4-8cfe-4bd4-b5f1-bbbb28cdbb74 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:04.285042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24212bf4-8cfe-4bd4-b5f1-bbbb28cdbb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:04.302976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-24212bf4-8cfe-4bd4-b5f1-bbbb28cdbb74 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:04.304183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24212bf4-8cfe-4bd4-b5f1-bbbb28cdbb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:04.312705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:22:04.348791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62624-f998-463e-84c5-507f550f02ae None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:04.359546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b62624-f998-463e-84c5-507f550f02ae None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:04.363110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366244cf-16c6-4e1f-8dd7-d13842d1bdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:04.363754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366244cf-16c6-4e1f-8dd7-d13842d1bdcc service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:04.364041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366244cf-16c6-4e1f-8dd7-d13842d1bdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:04.364317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366244cf-16c6-4e1f-8dd7-d13842d1bdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:04.374714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366244cf-16c6-4e1f-8dd7-d13842d1bdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:04.376166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366244cf-16c6-4e1f-8dd7-d13842d1bdcc service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:04.387067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 770/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:22:08.239682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927258-cd9b-43c4-9394-f1e8b5b74746 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:08.240291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927258-cd9b-43c4-9394-f1e8b5b74746 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:08.240291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927258-cd9b-43c4-9394-f1e8b5b74746 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:08.241690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:22:08.247706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f229ec-128f-4d09-a036-77c4db3a929b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:08.248256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f229ec-128f-4d09-a036-77c4db3a929b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:08.248256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f229ec-128f-4d09-a036-77c4db3a929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:08.254902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=62 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:08.270365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-79f229ec-128f-4d09-a036-77c4db3a929b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:08.271570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-79f229ec-128f-4d09-a036-77c4db3a929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:08.280145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:22:08.548392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927258-cd9b-43c4-9394-f1e8b5b74746 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:08.550173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f927258-cd9b-43c4-9394-f1e8b5b74746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:08.607806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927258-cd9b-43c4-9394-f1e8b5b74746 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:08.611460 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0449cc-88aa-4dff-9495-cfd5cbca6574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:08.612098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0449cc-88aa-4dff-9495-cfd5cbca6574 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:08.612469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0449cc-88aa-4dff-9495-cfd5cbca6574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:08.612753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0449cc-88aa-4dff-9495-cfd5cbca6574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:08.622577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0449cc-88aa-4dff-9495-cfd5cbca6574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:08.624022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0449cc-88aa-4dff-9495-cfd5cbca6574 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:08.634116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 765/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:22:10.869721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ddcd8-7171-4793-91d8-639a7dabcb92 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:10.870343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ddcd8-7171-4793-91d8-639a7dabcb92 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:10.870456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ddcd8-7171-4793-91d8-639a7dabcb92 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:10.872962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:10.879025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f2d2-3697-42f9-8fc5-838c3cd639e3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:10.879514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f2d2-3697-42f9-8fc5-838c3cd639e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:10.879663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f2d2-3697-42f9-8fc5-838c3cd639e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:10.902733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1849f2d2-3697-42f9-8fc5-838c3cd639e3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:10.903953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1849f2d2-3697-42f9-8fc5-838c3cd639e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:10.912043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:22:11.185710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ddcd8-7171-4793-91d8-639a7dabcb92 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:11.187436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b16ddcd8-7171-4793-91d8-639a7dabcb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:11.200319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ddcd8-7171-4793-91d8-639a7dabcb92 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:11.203858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660e0e3-bd2e-4787-b4e5-00a5b5730ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:11.204486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e0e3-bd2e-4787-b4e5-00a5b5730ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:11.204765 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e0e3-bd2e-4787-b4e5-00a5b5730ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:11.205035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e0e3-bd2e-4787-b4e5-00a5b5730ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:11.214596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e0e3-bd2e-4787-b4e5-00a5b5730ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:11.216016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e0e3-bd2e-4787-b4e5-00a5b5730ce6 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:11.225726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 773/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:22:20.897248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=32 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:21.221500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:56.666388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa0eee-6bcf-4208-8159-364ab6ab40af None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.668021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa0eee-6bcf-4208-8159-364ab6ab40af None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.668757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa0eee-6bcf-4208-8159-364ab6ab40af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.711249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d9aa0eee-6bcf-4208-8159-364ab6ab40af None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:56.712755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9aa0eee-6bcf-4208-8159-364ab6ab40af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:56.725331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 767/1540] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:23:56.736202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.737413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.738195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.776723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36b30-bcf9-4895-93d4-ff93e3b88a72 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.777230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36b30-bcf9-4895-93d4-ff93e3b88a72 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.777424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36b30-bcf9-4895-93d4-ff93e3b88a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.799742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:56.803600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:56.819964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dac36b30-bcf9-4895-93d4-ff93e3b88a72 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:56.821293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dac36b30-bcf9-4895-93d4-ff93e3b88a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:56.835154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 774/1541] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:23:56.841235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:56.843838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 768/1542] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:56.855198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbde1e-f0a0-4e0e-99e9-0a689ec886c0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.855652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbde1e-f0a0-4e0e-99e9-0a689ec886c0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.856046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbde1e-f0a0-4e0e-99e9-0a689ec886c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.866387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a426f8-4884-4bf0-a5a5-f50171af60c9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:56.891155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-81bbde1e-f0a0-4e0e-99e9-0a689ec886c0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:56.891812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:56.892415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81bbde1e-f0a0-4e0e-99e9-0a689ec886c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:56.893332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.893851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.894413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.895824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:56.896386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:56.898395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:23:56.898395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:23:56.898395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:23:56.900555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:56.917222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 769/1543] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:56.918531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebcd9a-d4e3-4745-8d6a-e8e0e14e4efa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.918849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebcd9a-d4e3-4745-8d6a-e8e0e14e4efa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.919140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebcd9a-d4e3-4745-8d6a-e8e0e14e4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.957163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 775/1544] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:23:56.958196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:56.962266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c9ebcd9a-d4e3-4745-8d6a-e8e0e14e4efa None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:56.963492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9ebcd9a-d4e3-4745-8d6a-e8e0e14e4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:56.977200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0154-53af-49fc-838f-5b3dd14009d5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:56.984399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 770/1545] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:56.986981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f90c6-aff0-405a-ba1c-33f4a55e3984 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.987350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f90c6-aff0-405a-ba1c-33f4a55e3984 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.987544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f90c6-aff0-405a-ba1c-33f4a55e3984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.993044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:56.993740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:56.994120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:56.994395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:56.995132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:56.995438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:56.997078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.026816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 776/1546] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:57.031063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.032950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-471f90c6-aff0-405a-ba1c-33f4a55e3984 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.034607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-471f90c6-aff0-405a-ba1c-33f4a55e3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.049460 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3f4-b2fb-4c5f-a8bf-55417e7da674 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.057546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 771/1547] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.059116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.059431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.059707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.065653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb92ff-21d6-4833-b832-cd88ed100411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.066566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb92ff-21d6-4833-b832-cd88ed100411 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.067675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb92ff-21d6-4833-b832-cd88ed100411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.068128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb92ff-21d6-4833-b832-cd88ed100411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.068695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb92ff-21d6-4833-b832-cd88ed100411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.074098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb92ff-21d6-4833-b832-cd88ed100411 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.107449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.108776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.139198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 772/1548] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.140769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 777/1549] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:57.146573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.148019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.148336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.148621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.169056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f3ac-9282-4bd7-9880-36111444bc69 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.192721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.194003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.330947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.332712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.333215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.333692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.334997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.337770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:23:57.337770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:23:57.337770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:23:57.344626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.421529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 778/1550] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.426077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.435972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 773/1551] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:57.438239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.453713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14c680-a10c-41a8-8e0a-ab8acf5b7fc5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.568255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.569405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.569900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.570427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.571714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.573699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:23:57.573699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:23:57.573699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:23:57.576195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b20fb7-0828-4688-9d6d-e984d22d8f25 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.586702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a438c-dd6e-4dc6-ac6a-e440def2b023 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.594736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.595916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.596408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.596886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.598345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:57.598888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.601928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de14b5-ccf4-4ea5-aff3-135786f105ab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.609484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 779/1552] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:57.611867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.612391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.613429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.628808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 774/1553] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:57.628808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.628808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.628808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.642927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.644714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.655006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 780/1554] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.655279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.656779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.657004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.668875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 775/1555] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.670209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.673810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e9160-1d41-4e5c-8705-6349cfdf7b3d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.679119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.679803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.680104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.680355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.681092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:57.681405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.683149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc0fcb-f0bf-4b1a-9d0d-c3adc21b38e9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.684316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1071fa-e45f-4627-85ea-9e71a7571afd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.690326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a0eb1-2a92-4870-9dc1-e23dcadbd610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.691841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0eb1-2a92-4870-9dc1-e23dcadbd610 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.692298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0eb1-2a92-4870-9dc1-e23dcadbd610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.692744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0eb1-2a92-4870-9dc1-e23dcadbd610 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.693527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a0eb1-2a92-4870-9dc1-e23dcadbd610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.696388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a0eb1-2a92-4870-9dc1-e23dcadbd610 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.705448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 781/1556] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:57.705448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.705448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.705448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.730537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 776/1557] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:57.732669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.733239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.733671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.736015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.737311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.747958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 782/1558] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.750073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.760565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.762339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.767673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4878c1-304c-43a2-a4b9-4ab6a768a52f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.775798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60aa8a-c89d-457c-87f0-8f902a47549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.776098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 777/1559] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.777151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aa8a-c89d-457c-87f0-8f902a47549d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.777643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aa8a-c89d-457c-87f0-8f902a47549d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.778167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aa8a-c89d-457c-87f0-8f902a47549d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.779598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60aa8a-c89d-457c-87f0-8f902a47549d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.782825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60aa8a-c89d-457c-87f0-8f902a47549d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.783706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.786878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:57.799332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 783/1560] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:57.800800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e29c0-2bc5-4c34-afca-62709135ac46 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.801304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e29c0-2bc5-4c34-afca-62709135ac46 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.801440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e29c0-2bc5-4c34-afca-62709135ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.803207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a40a6c-f31a-4613-bd93-40e9bcfd3d3e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.808579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.809254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.809543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.809818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.810592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.812576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.818060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:57.825254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-134e29c0-2bc5-4c34-afca-62709135ac46 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.827451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-134e29c0-2bc5-4c34-afca-62709135ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.841019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 784/1561] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.843181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.843731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.844194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.855616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 778/1562] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:57.856680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.869813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:57.871091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:57.943203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3b1f-da44-4b5a-b357-6004aad02aff admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.948277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cda67-bc7b-4c2d-a46f-573155835980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.948945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cda67-bc7b-4c2d-a46f-573155835980 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.949226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cda67-bc7b-4c2d-a46f-573155835980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.949583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cda67-bc7b-4c2d-a46f-573155835980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.950226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cda67-bc7b-4c2d-a46f-573155835980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.952165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cda67-bc7b-4c2d-a46f-573155835980 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:57.966533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 785/1563] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:57.967871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:57.986095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3d640-5843-4bfa-880b-a45256eec80e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:57.990574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 779/1564] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:57.992296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5069e-3b1a-4810-a1ae-adfb53c2689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:57.992811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.993198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5069e-3b1a-4810-a1ae-adfb53c2689e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:57.993396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.993665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5069e-3b1a-4810-a1ae-adfb53c2689e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:57.993878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.994166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5069e-3b1a-4810-a1ae-adfb53c2689e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:57.995000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5069e-3b1a-4810-a1ae-adfb53c2689e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:57.996792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5069e-3b1a-4810-a1ae-adfb53c2689e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.008849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 786/1565] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:58.013237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.013553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.014083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.024754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:58.027887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:58.041848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:58.043796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:58.121251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 780/1566] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:58.122537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.136712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 787/1567] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:58.137156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be4c37-592b-48a0-993a-bde3794ac022 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.138874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.142816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.143505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.143783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.144605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.145341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.147192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.152738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bbda1-789f-44df-84bc-8c8e91b2963c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.158411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.158805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 781/1568] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:58.159303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.160223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.160407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.160810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.161863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:58.162341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.164180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.175845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299af65-e174-4346-a15e-574d5c2212e3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.180782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.181461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.181738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.182043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.182553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 788/1569] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:58.182737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.184108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.184778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.203716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c785d-8f89-4984-aeaf-1c9189f46cf8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.211027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.211978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.212284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 782/1570] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/users => generated 282 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.213390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.214555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.215000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.215949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:58.216353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.218164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.230550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801db92-77f9-4682-89b4-a12ead5f1c2b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.237868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.238532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 789/1571] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:58.238978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.239437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.239861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.239978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.241026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.244592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.255885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9553c5-471b-4826-bd48-114153db0ab5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.261388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.262145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.262463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.262728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.263468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.265111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.275510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 783/1572] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.276969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.277702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 790/1573] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:58.278730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.291974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0196e73-2e32-438e-a7f8-982b4d2ae7f4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.297586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.298312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.298594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.298868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.299634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:58.300028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.301617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.302470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d626c9-a5b4-44ee-9cee-41d22f19e45e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.307434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.308112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.308391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.308664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.309402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:23:58.309996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.311768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.317717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 791/1574] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:58.317717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.325086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 784/1575] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:23:58.326632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.340854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa3fa-9bd2-4812-892b-bd29fd783860 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.343605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544ef5e-ed5c-4754-9fb0-dd48c009666b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.346098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.347699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.348150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.348611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] PATH_INFO: `/v3/projects/76046ea3b70243e6b39ff888fbc04f22/users/ddff1247af8f464fa05c8194e2abc690/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.350349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.351438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.351880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.352322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.353468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.356653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.373547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:58.373791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76046ea3b70243e6b39ff888fbc04f22, user_id=ddff1247af8f464fa05c8194e2abc690, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.378647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.397219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 785/1576] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.397607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 792/1577] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:23:58 2022] PUT /identity/v3/projects/76046ea3b70243e6b39ff888fbc04f22/users/ddff1247af8f464fa05c8194e2abc690/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:23:58.398453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.398702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.413605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:58.481420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8be5d9-a018-48a2-8eaa-e5d6bd11d89f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.495755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d509-bd77-4091-885c-48647f2f9fe2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.500742 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.501440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.501713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.502004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.502730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.504494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.515687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 786/1578] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:58.516638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.527617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd0ac-8ec7-4921-83f2-82130db15d53 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.532940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.534068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.534418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.535516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] PATH_INFO: `/v3/projects/4e795682eb3f48afbdd6f8e5d074762b/users/3edda370ad374be6bcd7f6ac2831b98f/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.556311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e795682eb3f48afbdd6f8e5d074762b, user_id=3edda370ad374be6bcd7f6ac2831b98f, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.558137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:23:58.558137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:23:58.558137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:23:58.561413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.583024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 787/1579] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:23:58 2022] PUT /identity/v3/projects/4e795682eb3f48afbdd6f8e5d074762b/users/3edda370ad374be6bcd7f6ac2831b98f/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:23:58.584581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.585380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.586470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.586927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.587393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.588374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.591887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.634308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 793/1580] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.635399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.685231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec64a6-e576-443e-9f89-53f710afacc6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.744958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ab22d-e236-4b80-b17a-be488a38a59b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.750616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.751360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.751783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.752194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.752987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.755732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.759916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.760767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.761266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.761671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.762649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.764785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.777249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 788/1581] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:58.778156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.790601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 794/1582] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.790601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.796620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376984-c786-4f4a-8065-bf03076d1e2e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.802492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:58.828002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:58.874507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7acc-71ed-4921-9bf6-271b92a103fe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.874889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.875661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.876081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.876355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.877049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.879625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.880023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d492-e2b8-4de1-93a4-66a1a4115dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.880890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d492-e2b8-4de1-93a4-66a1a4115dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.881177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d492-e2b8-4de1-93a4-66a1a4115dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.881458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d492-e2b8-4de1-93a4-66a1a4115dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.882327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d492-e2b8-4de1-93a4-66a1a4115dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.884691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d492-e2b8-4de1-93a4-66a1a4115dd6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:58.906681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 795/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.908014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.908417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.908696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.910802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 789/1584] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:58.911951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:58.942930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] MFA Rules not processed for user `ddff1247af8f464fa05c8194e2abc690`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:58.944275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:58.979135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797c68b-6a32-42de-abb7-eb09bbeb5d3b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:58.984210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5954d-7456-46ed-9de4-492d36fe047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:58.984901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5954d-7456-46ed-9de4-492d36fe047b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:58.985179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5954d-7456-46ed-9de4-492d36fe047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:58.985446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5954d-7456-46ed-9de4-492d36fe047b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:58.986322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5954d-7456-46ed-9de4-492d36fe047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:58.988528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5954d-7456-46ed-9de4-492d36fe047b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.000896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 790/1585] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.002313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.002632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.002936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.024297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:59.026170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 796/1586] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:59.026386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:59.026878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.036609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 791/1587] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:59.038143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.039003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65345a3b-7baa-46a4-a94d-36d17112721f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.046550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.047584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.048464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.048843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.049756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.053797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.054191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe7fa-9392-4269-951a-f4486a66e951 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.060437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.061393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.061618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.061801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.062668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.064414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.081675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 797/1588] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:59.083473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.086936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 792/1589] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.088120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.100059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e0b0-5405-4744-8d84-a7435b0e1ee1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.100617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef1dda-0531-4179-ac4c-47e94da488ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.105562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.106475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.106757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.106900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.107054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.107438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.107719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.107884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.108038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.108696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.110083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.110364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.125543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 793/1590] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.126649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.136712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 798/1591] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/users => generated 282 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:59.137612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.138573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0db5aa-9f68-4809-a26d-cfa7c1a7e40d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.144248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.145342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.145756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.146306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.147194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.148923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174b922-ee89-4c68-82d6-9fb0139455f0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.149406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.157417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.158367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.158638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.158911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] PATH_INFO: `/v3/projects/b2d9674ffd4f4a41a073ff9f8ffbfd51/users/addf27f25298498eb2032f9b0409f007/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.174862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 794/1592] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:59.179091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.181450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d9674ffd4f4a41a073ff9f8ffbfd51, user_id=addf27f25298498eb2032f9b0409f007, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.186748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.194292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914277c-5785-4d1b-aabf-acb43705d824 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.200454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.201378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.201938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.202378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.203122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.205863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 799/1593] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:23:59 2022] PUT /identity/v3/projects/b2d9674ffd4f4a41a073ff9f8ffbfd51/users/addf27f25298498eb2032f9b0409f007/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:23:59.206110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.207847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.214187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:59.259881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 795/1594] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:59.259881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.292092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:59.297214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:59.316033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b8ca-74a6-46ec-aeb1-254d318a0706 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.352638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c66712-3496-4ab4-8606-1db3122cde62 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.358704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.359525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.359865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.360210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.361144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.363873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.375477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 796/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.376364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.382849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.383525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.383814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.384091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.390892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704359ac-f5fd-4655-8dfa-9e2cadc5597c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.396011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.396598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.397550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.397788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.398207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.398578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] PATH_INFO: `/v3/projects/9e18d55a5dad42c1af7dc8ada5c31b2b/users/2b79e267e27d4c498cb4e1b46007b8d5/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.408347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 800/1596] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:23:59.409217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.422449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806d82b-00d1-4e3f-96a1-634806d0e9ae service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.423007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e18d55a5dad42c1af7dc8ada5c31b2b, user_id=2b79e267e27d4c498cb4e1b46007b8d5, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.426651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.434416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.436132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.436132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.436132 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.436838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.442072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.459086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 801/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.459086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.470286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 797/1598] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:23:59 2022] PUT /identity/v3/projects/9e18d55a5dad42c1af7dc8ada5c31b2b/users/2b79e267e27d4c498cb4e1b46007b8d5/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:23:59.470286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.479889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b09a4-4a18-4dd7-8ec1-b10f30f06d14 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.576606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a32195-22e7-45f9-b944-0c16f6923eeb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.586643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d6c5-80f9-434b-9b5d-a1073718bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.587392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d6c5-80f9-434b-9b5d-a1073718bd51 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.587676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d6c5-80f9-434b-9b5d-a1073718bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.587949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d6c5-80f9-434b-9b5d-a1073718bd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.588704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d6c5-80f9-434b-9b5d-a1073718bd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.590697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d6c5-80f9-434b-9b5d-a1073718bd51 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.597066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.598654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.599000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.599439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.600760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.602067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.606763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 798/1599] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.611419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.611663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.611938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.615117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 802/1600] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.616006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.647593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393cbdc-e153-4f6e-8de9-bc221bbf83bf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.653719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] MFA Rules not processed for user `addf27f25298498eb2032f9b0409f007`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:59.655908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:59.665663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.667083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.667611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.668127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.669577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.673865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.713834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 803/1601] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:23:59.715606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.735815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e3f0-c20e-4f92-8092-c01a59c72d67 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.746646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b317d-4edd-4c52-8f13-0e9bcacb36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.748649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b317d-4edd-4c52-8f13-0e9bcacb36a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.749307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b317d-4edd-4c52-8f13-0e9bcacb36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.749922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b317d-4edd-4c52-8f13-0e9bcacb36a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.752235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b317d-4edd-4c52-8f13-0e9bcacb36a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.752721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 799/1602] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:59.753573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.756269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b317d-4edd-4c52-8f13-0e9bcacb36a1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.765561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff7eb-0dc3-4825-8c50-6e322dbcc6d8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.771965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.772757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 804/1603] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.774537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.774859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.775103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.777045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.777336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.777615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] PATH_INFO: `/v3/projects/34209acea19c42ef84ad5f6c20e5c0a9/users/1b6e4c96f7054aaeaafebfecdd960467/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.795355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=34209acea19c42ef84ad5f6c20e5c0a9, user_id=1b6e4c96f7054aaeaafebfecdd960467, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.798047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.801002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:59.810799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] MFA Rules not processed for user `2b79e267e27d4c498cb4e1b46007b8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:23:59.812314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:23:59.818705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 800/1604] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:23:59 2022] PUT /identity/v3/projects/34209acea19c42ef84ad5f6c20e5c0a9/users/1b6e4c96f7054aaeaafebfecdd960467/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:23:59.823461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.879870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:59.912019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 805/1605] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:23:59.913308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.937152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3109c0-d106-4c3a-92ac-fb49c0d8a8ec admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.945629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:23:59.946740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:23:59.947053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:23:59.947408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:23:59.948692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:23:59.950711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:23:59.971182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 801/1606] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:23:59.972976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:23:59.986314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee7582-488d-4b04-b793-32d24453de19 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:23:59.999689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.000442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.000989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.001278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.002350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.004472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.024499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 802/1607] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:00.027080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.041472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a86f2-550a-40cf-a96f-82e3052ebd8b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.047839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.048794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.049246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.049679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.051266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.054267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.067905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411383b-8cb6-403d-ba29-38edb9c29b67 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.079491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e035e-94c0-4f1e-9a36-f80468b6c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.080694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e035e-94c0-4f1e-9a36-f80468b6c93d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.081307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e035e-94c0-4f1e-9a36-f80468b6c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.081955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e035e-94c0-4f1e-9a36-f80468b6c93d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.085583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e035e-94c0-4f1e-9a36-f80468b6c93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.090243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e035e-94c0-4f1e-9a36-f80468b6c93d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.099063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 803/1608] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:00 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:00.100317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.111341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 806/1609] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:00.112086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243c49-d5e5-4f5f-a487-618e19ad3525 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.112261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243c49-d5e5-4f5f-a487-618e19ad3525 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.113464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243c49-d5e5-4f5f-a487-618e19ad3525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.136419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cd243c49-d5e5-4f5f-a487-618e19ad3525 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:00.137838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cd243c49-d5e5-4f5f-a487-618e19ad3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:00.200613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a052-085d-493b-b508-334ed12a571d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.207446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.208824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.209512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.210082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] PATH_INFO: `/v3/projects/5ebdfd12708a4d41a04d4ed1c2a5f42d/users/c72069d190494f74a1287f41d5a7afd4/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.241809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 807/1610] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:00.243971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f34a9-e2b5-4a37-a62a-33d6c2fb9ff3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.244434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f34a9-e2b5-4a37-a62a-33d6c2fb9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.244885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f34a9-e2b5-4a37-a62a-33d6c2fb9ff3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.248183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 808/1611] 10.222.0.61 () {54 vars in 961 bytes} [Fri May 27 03:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:00.249062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f34a9-e2b5-4a37-a62a-33d6c2fb9ff3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.252645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebdfd12708a4d41a04d4ed1c2a5f42d, user_id=c72069d190494f74a1287f41d5a7afd4, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.258794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.274084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f34a9-e2b5-4a37-a62a-33d6c2fb9ff3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.281985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.283585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.284177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.285272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] PATH_INFO: `/v3/projects/4cc2f3a125874013802139b93f4670ef/users/4a9445ed7a4645af8e578d797e7900da/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.299008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 804/1612] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:00 2022] PUT /identity/v3/projects/5ebdfd12708a4d41a04d4ed1c2a5f42d/users/c72069d190494f74a1287f41d5a7afd4/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:00.300184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.317300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc2f3a125874013802139b93f4670ef, user_id=4a9445ed7a4645af8e578d797e7900da, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.323124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.354292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 809/1613] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:00 2022] PUT /identity/v3/projects/4cc2f3a125874013802139b93f4670ef/users/4a9445ed7a4645af8e578d797e7900da/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:00.354292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.372686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:00.402040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7302a-7cc7-4e3e-91eb-85b950011de6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.515846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d1b1-ef81-47f8-be4a-d2076bb2bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.517614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d1b1-ef81-47f8-be4a-d2076bb2bad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.518503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d1b1-ef81-47f8-be4a-d2076bb2bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.519863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d1b1-ef81-47f8-be4a-d2076bb2bad9 admin admin] PATH_INFO: `/v3/projects/0f57a195cc2b47c48190be9cfba8b010/users/53cb324ed0e64799a570b9fea24b2fa4/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.521798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a4d1-a5c1-48dd-bf2e-03b075a09d77 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.530604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.531861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.532349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.532906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.534252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.538286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.553868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:00.554985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d1b1-ef81-47f8-be4a-d2076bb2bad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f57a195cc2b47c48190be9cfba8b010, user_id=53cb324ed0e64799a570b9fea24b2fa4, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.561295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d1b1-ef81-47f8-be4a-d2076bb2bad9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.580921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 810/1614] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:00 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:00.580921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.586176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 805/1615] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:00 2022] PUT /identity/v3/projects/0f57a195cc2b47c48190be9cfba8b010/users/53cb324ed0e64799a570b9fea24b2fa4/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:00.591009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.591369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.591655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.601478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceb3bc-8a10-41c1-b4af-65de652300b7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.614245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:00.615503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:00.734856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521824f6-e487-45a7-8ec0-a11640b84573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.736994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521824f6-e487-45a7-8ec0-a11640b84573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.737196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 806/1616] 10.222.0.61 () {58 vars in 1058 bytes} [Fri May 27 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:00.737611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:00.746442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521824f6-e487-45a7-8ec0-a11640b84573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.746944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521824f6-e487-45a7-8ec0-a11640b84573 admin admin] PATH_INFO: `/v3/projects/0ef5f0faa6ae4bb680ded0daf7863aaf/users/ef15d18ff263486bb73c9f19aac2dd84/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.793700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521824f6-e487-45a7-8ec0-a11640b84573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef5f0faa6ae4bb680ded0daf7863aaf, user_id=ef15d18ff263486bb73c9f19aac2dd84, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:00.799636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521824f6-e487-45a7-8ec0-a11640b84573 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:00.819450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 811/1617] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:00 2022] PUT /identity/v3/projects/0ef5f0faa6ae4bb680ded0daf7863aaf/users/ef15d18ff263486bb73c9f19aac2dd84/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:00.820881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102a17-1689-49fc-9ddd-577d31dbe560 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.821248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102a17-1689-49fc-9ddd-577d31dbe560 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.821674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102a17-1689-49fc-9ddd-577d31dbe560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.825905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa002-4699-44ff-9ab3-4166d864f9ec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:00.845067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:00.869266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-80102a17-1689-49fc-9ddd-577d31dbe560 None None] MFA Rules not processed for user `c72069d190494f74a1287f41d5a7afd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:00.870890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-80102a17-1689-49fc-9ddd-577d31dbe560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:00.908195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b758f-48ca-4f74-8938-140fb4c79bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:00.909334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b758f-48ca-4f74-8938-140fb4c79bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.909868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b758f-48ca-4f74-8938-140fb4c79bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.910389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b758f-48ca-4f74-8938-140fb4c79bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.957495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 812/1618] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:00.959652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:00.960333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:00.960781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:00.981843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:00.983184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:01.021910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b758f-48ca-4f74-8938-140fb4c79bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.023413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b758f-48ca-4f74-8938-140fb4c79bfb service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.038041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 807/1619] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:01.039786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3c64-404d-48a5-9e95-1473eac36080 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.040011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3c64-404d-48a5-9e95-1473eac36080 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.040224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3c64-404d-48a5-9e95-1473eac36080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.082310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 813/1620] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:01.083687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b13b3c64-404d-48a5-9e95-1473eac36080 None None] MFA Rules not processed for user `3edda370ad374be6bcd7f6ac2831b98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:01.086496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b13b3c64-404d-48a5-9e95-1473eac36080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:01.086864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.099347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:01.108400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927de4c-a4e2-48fe-86bb-c1197c0e524a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.116581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.117395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.117745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.118155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.118988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.120730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.132272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 814/1621] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:01.133654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.149609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb76d2-cbc8-4ead-b322-c6bc1ee5344b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.155756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.156763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.157153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.157605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.158583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.161125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.175959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 815/1622] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:01.177620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.218006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 808/1623] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:01.218006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.218006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.218006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.248865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] MFA Rules not processed for user `ef15d18ff263486bb73c9f19aac2dd84`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:01.253654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:01.329183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a419-0685-4686-b283-2a1e7c56cbc9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.331097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:01.338095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.339385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.339737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.340871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.377062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 809/1624] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:01.377062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.395012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c13d8-5e39-458f-9b3b-941e30c4cc9c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.400623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.401310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.401596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.401879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.402623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.404631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.436532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.438433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.451259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 810/1625] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:01.451259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.457854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 816/1626] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:01.458999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.472725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4e61-0faf-40ac-a0af-278c6f2bf119 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.547995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f61b5e-2f93-4232-87c2-ef624d737bbd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.555776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.556749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.557097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.557380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.582391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e8286-77ab-4226-bac1-be213c6e5139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.585255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e8286-77ab-4226-bac1-be213c6e5139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.586375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e8286-77ab-4226-bac1-be213c6e5139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.587095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e8286-77ab-4226-bac1-be213c6e5139 admin admin] PATH_INFO: `/v3/projects/c47393ba3f7c4b8e871e0eba40a7fd19/users/48ee91ab26034f4491fd7920b8ff68d6/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.629112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e8286-77ab-4226-bac1-be213c6e5139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47393ba3f7c4b8e871e0eba40a7fd19, user_id=48ee91ab26034f4491fd7920b8ff68d6, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.635839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e8286-77ab-4226-bac1-be213c6e5139 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.653176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.654751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.668088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 811/1627] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:01.669167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.682167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435c7c5-7aaf-4843-a0b8-eefa6f4fdf16 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.686927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 817/1628] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:01 2022] PUT /identity/v3/projects/c47393ba3f7c4b8e871e0eba40a7fd19/users/48ee91ab26034f4491fd7920b8ff68d6/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:01.692375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.696505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.697535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.714861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:01.745744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] MFA Rules not processed for user `3edda370ad374be6bcd7f6ac2831b98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:01.747496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:01.765275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.766319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.766792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.767129 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] PATH_INFO: `/v3/projects/0f57a195cc2b47c48190be9cfba8b010/users/53cb324ed0e64799a570b9fea24b2fa4/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.769472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f57a195cc2b47c48190be9cfba8b010, user_id=53cb324ed0e64799a570b9fea24b2fa4, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.773629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.789250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 812/1629] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:01 2022] PUT /identity/v3/projects/0f57a195cc2b47c48190be9cfba8b010/users/53cb324ed0e64799a570b9fea24b2fa4/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:01.790182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.801946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:01.865204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 818/1630] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:01.867116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.883784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6675fa-c12a-4e9e-ab61-dac9002c783c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.890455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.891293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.891580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.891857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.892626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.895578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.897749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff942af7-eeed-4a65-8d5e-d25dad929115 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.905019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37734ce-cbe0-4241-bea8-729bf866aecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.906298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37734ce-cbe0-4241-bea8-729bf866aecc admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.906648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37734ce-cbe0-4241-bea8-729bf866aecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.906996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37734ce-cbe0-4241-bea8-729bf866aecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.908611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37734ce-cbe0-4241-bea8-729bf866aecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.913934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37734ce-cbe0-4241-bea8-729bf866aecc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.937328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 819/1631] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:01.938930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:01.955556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807070e9-5a16-4d61-bc2f-03678afd625a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:01.963483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b0ebf-5daa-49c7-ad85-9d69fad6eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:01.964817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0ebf-5daa-49c7-ad85-9d69fad6eca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.965190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0ebf-5daa-49c7-ad85-9d69fad6eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.965561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0ebf-5daa-49c7-ad85-9d69fad6eca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.966579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b0ebf-5daa-49c7-ad85-9d69fad6eca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:01.969092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b0ebf-5daa-49c7-ad85-9d69fad6eca8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:01.972764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 813/1632] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:01.975578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.976098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.976607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.987914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 820/1633] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:01.987914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec80d-051b-4d04-8de0-64d084794f36 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.987914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec80d-051b-4d04-8de0-64d084794f36 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.988688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ec80d-051b-4d04-8de0-64d084794f36 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.990724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 821/1634] 10.222.0.61 () {54 vars in 912 bytes} [Fri May 27 03:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:01.995861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04804e4-21aa-4390-aadb-486f793e839e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:01.996149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04804e4-21aa-4390-aadb-486f793e839e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:01.996521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04804e4-21aa-4390-aadb-486f793e839e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:01.998393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 822/1635] 10.222.0.61 () {54 vars in 961 bytes} [Fri May 27 03:24:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:02.003906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04804e4-21aa-4390-aadb-486f793e839e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.029050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] MFA Rules not processed for user `53cb324ed0e64799a570b9fea24b2fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:02.031048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:02.104705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04804e4-21aa-4390-aadb-486f793e839e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:02.110877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:02.111856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.112201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.112591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.113703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:02.116488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:02.129593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 823/1636] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:02.131224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.141867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 814/1637] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:02.143079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.153124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b24d1-bf55-45af-902c-8542d2be03fe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:02.155874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476273-4a77-40c6-90e9-2f9c29cc0e79 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:02.161693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b15e6-c39c-498b-badb-19ebf46ffa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:02.162349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec7a9-371b-4428-a918-e7ced5e79580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:02.163111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b15e6-c39c-498b-badb-19ebf46ffa63 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.163683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec7a9-371b-4428-a918-e7ced5e79580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.163907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b15e6-c39c-498b-badb-19ebf46ffa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.164306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec7a9-371b-4428-a918-e7ced5e79580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.164451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b15e6-c39c-498b-badb-19ebf46ffa63 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.164872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec7a9-371b-4428-a918-e7ced5e79580 admin admin] PATH_INFO: `/v3/projects/c47393ba3f7c4b8e871e0eba40a7fd19/users/48ee91ab26034f4491fd7920b8ff68d6/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.165889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b15e6-c39c-498b-badb-19ebf46ffa63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:02.167446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ec7a9-371b-4428-a918-e7ced5e79580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47393ba3f7c4b8e871e0eba40a7fd19, user_id=48ee91ab26034f4491fd7920b8ff68d6, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:02.168614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b15e6-c39c-498b-badb-19ebf46ffa63 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:02.170817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ec7a9-371b-4428-a918-e7ced5e79580 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:02.197103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 815/1638] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:02 2022] PUT /identity/v3/projects/c47393ba3f7c4b8e871e0eba40a7fd19/users/48ee91ab26034f4491fd7920b8ff68d6/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:02.197103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.197103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.197103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.207675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 824/1639] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:02 2022] POST /identity/v3/users => generated 289 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:02.207675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.207675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.208161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.233542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:02.235856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:02.247570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:02.249801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:02.335491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:02.350303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:02.352420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 816/1640] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:24:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:02.353451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.387555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 825/1641] 10.222.0.61 () {58 vars in 1058 bytes} [Fri May 27 03:24:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:02.388331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.475729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d069a-3455-4543-b825-3cd3217c8114 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:02.496844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f4b7-38d8-4142-ab47-469fef757eee None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:02.497325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef133e9-2812-4a1e-a7a9-e1438991e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:02.499079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef133e9-2812-4a1e-a7a9-e1438991e029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.499239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef133e9-2812-4a1e-a7a9-e1438991e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.499688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef133e9-2812-4a1e-a7a9-e1438991e029 admin admin] PATH_INFO: `/v3/projects/ca361713077a4a76aa473b3a775f0679/users/5c09bf559f99483fb88fa490c55c26bd/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.507975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:02.508665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.509180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.509745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.553364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef133e9-2812-4a1e-a7a9-e1438991e029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca361713077a4a76aa473b3a775f0679, user_id=5c09bf559f99483fb88fa490c55c26bd, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:02.564463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef133e9-2812-4a1e-a7a9-e1438991e029 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:02.606912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 817/1642] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:02 2022] PUT /identity/v3/projects/ca361713077a4a76aa473b3a775f0679/users/5c09bf559f99483fb88fa490c55c26bd/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:02.611394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.611692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.611954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.652145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] MFA Rules not processed for user `48ee91ab26034f4491fd7920b8ff68d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:02.653426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:02.700897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:02.705489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:02.732638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 826/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:02.735802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.764581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790424-e4c4-4f44-bd18-6f44993d4569 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:02.818477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 818/1644] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:02.819325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:02.959453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:02.960192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:02.961629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:02.962195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:02.963011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:02.966913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:02.986290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 827/1645] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:02.987365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.009583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d709b66-6e6e-4c4f-8d85-83d5cef39f97 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.024072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.026169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.028869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.030521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.049578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:03.088085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:03.112026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50953-ca33-405f-8b53-daf3f175acc4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.123810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.124715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.125604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.126187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.248495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.248797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.250018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.250409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.263283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 828/1646] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:03.264524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.278285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6af72b-bd22-4bfb-a1b7-55602b6b78ba service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.288500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.290212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.290525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.291318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.292102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.293793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.297555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 819/1647] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:03.304790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.315437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 829/1648] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:03.319268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.328807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff139131-a3bb-4b6d-b364-d04bb5305cb2 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.338733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.340582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.340871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.341456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.347700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce87b-19da-4471-b658-896e07d42059 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.360976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.363091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.368140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.368523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] PATH_INFO: `/v3/projects/59c70dd71ca74cabbad9180807bff1a1/users/9a83935c63634e34b49b5e4b56280f05/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.376823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.376823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.421304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 820/1649] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:03.422213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.433903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c70dd71ca74cabbad9180807bff1a1, user_id=9a83935c63634e34b49b5e4b56280f05, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.436840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.447846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecff2e3-37e9-4eaa-9ce1-446cd68c1dfe service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.463188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc52fe0-17ab-4769-b6b9-fa1f44a2feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.464116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52fe0-17ab-4769-b6b9-fa1f44a2feb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.464402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52fe0-17ab-4769-b6b9-fa1f44a2feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.464740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 830/1650] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:03 2022] PUT /identity/v3/projects/59c70dd71ca74cabbad9180807bff1a1/users/9a83935c63634e34b49b5e4b56280f05/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:03.465067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52fe0-17ab-4769-b6b9-fa1f44a2feb3 admin admin] PATH_INFO: `/v3/projects/ca361713077a4a76aa473b3a775f0679/users/5c09bf559f99483fb88fa490c55c26bd/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.469256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.470923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc52fe0-17ab-4769-b6b9-fa1f44a2feb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca361713077a4a76aa473b3a775f0679, user_id=5c09bf559f99483fb88fa490c55c26bd, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.478542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc52fe0-17ab-4769-b6b9-fa1f44a2feb3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.514951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 821/1651] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:03 2022] PUT /identity/v3/projects/ca361713077a4a76aa473b3a775f0679/users/5c09bf559f99483fb88fa490c55c26bd/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:03.538480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb32b-5a03-440b-be47-30defa35c5f7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.538834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb32b-5a03-440b-be47-30defa35c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.539030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb32b-5a03-440b-be47-30defa35c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.599652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fabdb32b-5a03-440b-be47-30defa35c5f7 None None] MFA Rules not processed for user `5c09bf559f99483fb88fa490c55c26bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:03.600988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fabdb32b-5a03-440b-be47-30defa35c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:03.670452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe76f7c-8dcd-4f19-b2a6-aaa68a94261f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.761874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:03.803439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.806138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.806490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.807873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.808701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.814016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.841654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 831/1652] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:03.846668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:03.852932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 822/1653] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:03.871551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2edab8-a9bb-46f9-bad5-64203a0a23a6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:03.886123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b43f-d572-44af-81d5-cfd6edc6fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:03.887072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b43f-d572-44af-81d5-cfd6edc6fb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.887389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b43f-d572-44af-81d5-cfd6edc6fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.887694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b43f-d572-44af-81d5-cfd6edc6fb4f admin admin] PATH_INFO: `/v3/projects/59c70dd71ca74cabbad9180807bff1a1/users/9a83935c63634e34b49b5e4b56280f05/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:03.891705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b43f-d572-44af-81d5-cfd6edc6fb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c70dd71ca74cabbad9180807bff1a1, user_id=9a83935c63634e34b49b5e4b56280f05, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:03.903942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b43f-d572-44af-81d5-cfd6edc6fb4f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:03.953947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 832/1654] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:03 2022] PUT /identity/v3/projects/59c70dd71ca74cabbad9180807bff1a1/users/9a83935c63634e34b49b5e4b56280f05/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:03.969019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:03.969526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:03.970033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:04.038754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] MFA Rules not processed for user `9a83935c63634e34b49b5e4b56280f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:04.040506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:04.072605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dbe26-b0e3-44a1-aef7-8246f7f93df9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:04.073302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dbe26-b0e3-44a1-aef7-8246f7f93df9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:04.074082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dbe26-b0e3-44a1-aef7-8246f7f93df9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:04.076319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 833/1655] 10.222.0.61 () {54 vars in 912 bytes} [Fri May 27 03:24:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:04.084217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:04.084879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:04.086109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:04.150419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:04.152139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:04.224546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:04.274709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 823/1656] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:04.276325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:04.370636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 834/1657] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:24:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:04.389950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:04.391660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:04.543437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b48303-9c9c-44e9-a5f3-bc72e74fec96 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:04.560204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:04.562419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:04.565005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:04.567736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:04.713078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33635ebf-2c03-4bf5-bbf7-b5fdadc9f823 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:04.741763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:04.745346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:04.748992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:04.761670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:04.834853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:04.841487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:04.856483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:04.862016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:04.885652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 824/1658] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:04.888427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:04.905923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523b7d9-cec0-4fa6-b77e-a89dd25ca720 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:04.917660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 835/1659] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:04.919229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:04.920159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:04.920525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:04.920923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:04.944784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:04.946646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:04.973809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 825/1660] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:05.475171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:05.819159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49b2c7-cab4-4602-b237-d74e5cc5f10b service glance] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:05.837067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:05.838427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:05.838806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:05.839094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] PATH_INFO: `/v3/users/ddff1247af8f464fa05c8194e2abc690` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:05.844318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddff1247af8f464fa05c8194e2abc690)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:05.846479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:05.865367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:05.883069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:05.895787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ad921-b1d7-4fec-b44d-5d9e602142c0 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:05.900127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635defc8-7c2d-48e4-9afc-1b14e41a8b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:05.901720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635defc8-7c2d-48e4-9afc-1b14e41a8b71 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:05.902768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635defc8-7c2d-48e4-9afc-1b14e41a8b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:05.902768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635defc8-7c2d-48e4-9afc-1b14e41a8b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:05.966246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddff1247af8f464fa05c8194e2abc690'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:05.967039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddff1247af8f464fa05c8194e2abc690'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:05.986498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635defc8-7c2d-48e4-9afc-1b14e41a8b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:05.988447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635defc8-7c2d-48e4-9afc-1b14e41a8b71 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:05.993799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddff1247af8f464fa05c8194e2abc690'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:06.015585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 826/1661] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:06.016247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddff1247af8f464fa05c8194e2abc690'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:06.062729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-421da311-5e33-4c4f-b365-5f64f925571d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddff1247af8f464fa05c8194e2abc690'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:06.085415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 836/1662] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:05 2022] DELETE /identity/v3/users/ddff1247af8f464fa05c8194e2abc690 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:06.090058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:06.090394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:06.090619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:06.133371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:06.142810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:06.204760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:06.223501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39822ec0-19b4-4147-a309-0b51df02f1c9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:06.223853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39822ec0-19b4-4147-a309-0b51df02f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:06.224129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39822ec0-19b4-4147-a309-0b51df02f1c9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:06.225692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 837/1663] 10.222.0.61 () {54 vars in 912 bytes} [Fri May 27 03:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:06.233539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:06.233749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:06.233999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:06.326877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 827/1664] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:06.347870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:06.374497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:06.374772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:06.374772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:06.536556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 838/1665] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:06.570901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e4ad-7fee-424e-9520-1e091fee60f5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:06.585171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:06.586144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:06.587279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:06.587749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:06.611765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:06.616648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:06.650196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 828/1666] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:06.654595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:06.656439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:06.675565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ab6e-360c-418a-a30e-2c10a0bc1ff8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:06.693730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:06.694457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:06.694742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:06.695022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:06.731727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:06.735243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:06.773262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 839/1667] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:06.829877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:06.832882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:06.864970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c1cc6-02dd-4a3c-915f-ff994f9fbe91 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:06.875206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:06.876344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:06.876724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:06.877098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] PATH_INFO: `/v3/users/addf27f25298498eb2032f9b0409f007` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:06.880057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=addf27f25298498eb2032f9b0409f007)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:06.881239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: WARNING py.warnings [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:24:06.881239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: warnings.warn(msg) May 27 03:24:06.881239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: May 27 03:24:06.882856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:06.994871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:06.997480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:07.030878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addf27f25298498eb2032f9b0409f007'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.033763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2701-37e9-45b7-83e1-0fd2edb1d54c service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:07.067409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:07.069259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:07.069689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:07.071664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] PATH_INFO: `/v3/users/c72069d190494f74a1287f41d5a7afd4` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:07.077929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72069d190494f74a1287f41d5a7afd4)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:07.089417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:07.124207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addf27f25298498eb2032f9b0409f007'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.150557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addf27f25298498eb2032f9b0409f007'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.151921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addf27f25298498eb2032f9b0409f007'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.188278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45d61bf5-1373-4eef-92ce-391f86cef899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addf27f25298498eb2032f9b0409f007'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.226566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 829/1668] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:06 2022] DELETE /identity/v3/users/addf27f25298498eb2032f9b0409f007 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:07.232658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:07.233226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:07.233705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:07.294102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:07.295902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:07.297940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72069d190494f74a1287f41d5a7afd4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.311408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72069d190494f74a1287f41d5a7afd4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.348160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72069d190494f74a1287f41d5a7afd4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.361201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:07.376758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:07.379018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72069d190494f74a1287f41d5a7afd4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.463958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 830/1669] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:07.473990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:07.478363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:07.496247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-679e887f-0830-4a4c-9d12-1c0a5a8b0ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72069d190494f74a1287f41d5a7afd4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:07.534687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 840/1670] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:06 2022] DELETE /identity/v3/users/c72069d190494f74a1287f41d5a7afd4 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:07.541460 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:07.541991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:07.542454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:07.589817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:07.592755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:07.771451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334baf6a-7151-4da3-b1a4-d3214811c1b7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:07.801184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 841/1671] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:07.809332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:08.004656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb1a80-87ba-45b3-a393-169f5898e4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:08.005345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1a80-87ba-45b3-a393-169f5898e4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:08.005632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1a80-87ba-45b3-a393-169f5898e4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:08.005918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1a80-87ba-45b3-a393-169f5898e4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:08.043089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb1a80-87ba-45b3-a393-169f5898e4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:08.045194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb1a80-87ba-45b3-a393-169f5898e4b9 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:08.049362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7d26d-8c9b-4c1a-8bdc-ea285e7d521f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:08.071085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1011c-71e6-43f3-b79e-865f49557edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:08.076350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1011c-71e6-43f3-b79e-865f49557edd service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:08.077561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1011c-71e6-43f3-b79e-865f49557edd service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:08.079572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 831/1672] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:08.080936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1011c-71e6-43f3-b79e-865f49557edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:08.141347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1011c-71e6-43f3-b79e-865f49557edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:08.142876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1011c-71e6-43f3-b79e-865f49557edd service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:08.219854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 842/1673] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:08.236794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0015ae-8540-4614-bd40-253e38335d4b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:08.237214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0015ae-8540-4614-bd40-253e38335d4b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:08.238237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0015ae-8540-4614-bd40-253e38335d4b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:08.241436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 832/1674] 10.222.0.61 () {54 vars in 960 bytes} [Fri May 27 03:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:08.255649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:08.256030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:08.256432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:08.365501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:08.367023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:08.531593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 843/1675] 10.222.0.61 () {58 vars in 1057 bytes} [Fri May 27 03:24:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:08.553670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0015ae-8540-4614-bd40-253e38335d4b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:08.595765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0015ae-8540-4614-bd40-253e38335d4b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:08.623458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:08.624921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:08.625686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:08.626463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:08.634816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:08.684078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:08.687719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:08.726931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 833/1676] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:09.217364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:09.219699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:09.243653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4204c43-67e2-4dc1-9cd4-fa8998de9523 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:09.250719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:09.251839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:09.252355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:09.253414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] PATH_INFO: `/v3/projects/76046ea3b70243e6b39ff888fbc04f22` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:09.255474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76046ea3b70243e6b39ff888fbc04f22)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:09.257006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: WARNING py.warnings [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:24:09.257006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: warnings.warn(msg) May 27 03:24:09.257006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: May 27 03:24:09.258939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:09.278230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:09.427247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76046ea3b70243e6b39ff888fbc04f22', 'request_id': 'req-50ed53d7-cf9d-4262-ba63-e266df8ebf93'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:09.495475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76046ea3b70243e6b39ff888fbc04f22', 'request_id': 'req-50ed53d7-cf9d-4262-ba63-e266df8ebf93'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:09.536605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76046ea3b70243e6b39ff888fbc04f22', 'request_id': 'req-50ed53d7-cf9d-4262-ba63-e266df8ebf93'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:09.590212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] The token cache is being invalidate because project 76046ea3b70243e6b39ff888fbc04f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:09.590585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:09.592501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:09.601568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 844/1677] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:09 2022] DELETE /identity/v3/projects/76046ea3b70243e6b39ff888fbc04f22 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:09.603109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:09.618750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801e556-beca-4a12-9491-c082d7a75742 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:09.812029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:09.813079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:09.813428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:09.813871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] PATH_INFO: `/v3/users/53cb324ed0e64799a570b9fea24b2fa4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:09.817281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53cb324ed0e64799a570b9fea24b2fa4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:09.821226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:09.912317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:09.948223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53cb324ed0e64799a570b9fea24b2fa4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:09.989080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53cb324ed0e64799a570b9fea24b2fa4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:10.005290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53cb324ed0e64799a570b9fea24b2fa4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:10.006599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53cb324ed0e64799a570b9fea24b2fa4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:10.029679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53cb324ed0e64799a570b9fea24b2fa4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:10.061273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 834/1678] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:09 2022] DELETE /identity/v3/users/53cb324ed0e64799a570b9fea24b2fa4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:10.415793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:10.417877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:10.465688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed53d7-cf9d-4262-ba63-e266df8ebf93 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:10.710187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:10.714022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:10.809042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:10.810078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:10.810368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:10.810647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] PATH_INFO: `/v3/projects/5ebdfd12708a4d41a04d4ed1c2a5f42d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:10.815399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebdfd12708a4d41a04d4ed1c2a5f42d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:10.829206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:10.982257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f0973-3012-41d7-b0dd-65d4044edd05 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:11.004003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebdfd12708a4d41a04d4ed1c2a5f42d', 'request_id': 'req-26a92e68-05c5-4f7d-9deb-db6c815a23f0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.032883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebdfd12708a4d41a04d4ed1c2a5f42d', 'request_id': 'req-26a92e68-05c5-4f7d-9deb-db6c815a23f0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.053613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebdfd12708a4d41a04d4ed1c2a5f42d', 'request_id': 'req-26a92e68-05c5-4f7d-9deb-db6c815a23f0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.105140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] The token cache is being invalidate because project 5ebdfd12708a4d41a04d4ed1c2a5f42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:11.111314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.119387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.124064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 845/1679] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:10 2022] DELETE /identity/v3/projects/5ebdfd12708a4d41a04d4ed1c2a5f42d => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:11.126819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:11.133827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:11.195472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:11.196631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:11.197060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:11.198553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] PATH_INFO: `/v3/projects/b2d9674ffd4f4a41a073ff9f8ffbfd51` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:11.201086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d9674ffd4f4a41a073ff9f8ffbfd51)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:11.225262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:11.286971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:11.361833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d9674ffd4f4a41a073ff9f8ffbfd51', 'request_id': 'req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.368442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:11.370807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d9674ffd4f4a41a073ff9f8ffbfd51', 'request_id': 'req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.386702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d9674ffd4f4a41a073ff9f8ffbfd51', 'request_id': 'req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.431364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] The token cache is being invalidate because project b2d9674ffd4f4a41a073ff9f8ffbfd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:11.431851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.434721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.435662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a92e68-05c5-4f7d-9deb-db6c815a23f0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:11.437206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 835/1680] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:10 2022] DELETE /identity/v3/projects/b2d9674ffd4f4a41a073ff9f8ffbfd51 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:11.438128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:11.442600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:11.592107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9220a3-0847-419c-a8f5-9ac798ed8ad8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:11.611301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:11.615613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:11.618850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:11.621026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] PATH_INFO: `/v3/users/5c09bf559f99483fb88fa490c55c26bd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:11.639671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c09bf559f99483fb88fa490c55c26bd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:11.644369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:11.724228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:11.725462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:11.725846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:11.726276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] PATH_INFO: `/v3/users/ef15d18ff263486bb73c9f19aac2dd84` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:11.729664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef15d18ff263486bb73c9f19aac2dd84)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:11.732579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:11.790568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c09bf559f99483fb88fa490c55c26bd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.830104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c09bf559f99483fb88fa490c55c26bd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.851932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c09bf559f99483fb88fa490c55c26bd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.852925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c09bf559f99483fb88fa490c55c26bd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.854892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef15d18ff263486bb73c9f19aac2dd84'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.859856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef15d18ff263486bb73c9f19aac2dd84'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.875006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c09bf559f99483fb88fa490c55c26bd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.881720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef15d18ff263486bb73c9f19aac2dd84'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.889364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 836/1681] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:11 2022] DELETE /identity/v3/users/5c09bf559f99483fb88fa490c55c26bd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:11.893131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:11.900958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:11.905332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef15d18ff263486bb73c9f19aac2dd84'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.933560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-46924f7b-2fb1-41d9-9fa1-f8a63eff0e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef15d18ff263486bb73c9f19aac2dd84'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:11.956691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 846/1682] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:11 2022] DELETE /identity/v3/users/ef15d18ff263486bb73c9f19aac2dd84 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:11.961452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:11.961896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:11.962418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:12.001918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:12.005207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:12.104764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a028-8641-40d6-bc7a-c325d38f1cfe admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:12.117315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:12.130905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:12.187939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 847/1683] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:12.209722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:12.211304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:12.226314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:12.228722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:12.229111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:12.230212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] PATH_INFO: `/v3/users/48ee91ab26034f4491fd7920b8ff68d6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:12.231867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ee91ab26034f4491fd7920b8ff68d6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:12.235706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:12.350484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ee91ab26034f4491fd7920b8ff68d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:12.395608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ee91ab26034f4491fd7920b8ff68d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:12.403394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef26e2d-1bb6-4012-8547-2cfc966adc2f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:12.415560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:12.431431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ee91ab26034f4491fd7920b8ff68d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:12.432755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ee91ab26034f4491fd7920b8ff68d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:12.441152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:12.441823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:12.441823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:12.449489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:12.483829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ee91ab26034f4491fd7920b8ff68d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:12.507167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:12.509058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:12.546847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 837/1684] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:11 2022] DELETE /identity/v3/users/48ee91ab26034f4491fd7920b8ff68d6 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:12.572651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 848/1685] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:12.869527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:12.872687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:12.938568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:12.941227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:12.982583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3b1c9-502d-4b9a-bf68-0ef7eb8e24f6 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:13.163629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95059c30-f227-4bd4-82f0-6790494d0b5f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:13.181809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:13.183061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.183344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.183617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] PATH_INFO: `/v3/users/2b79e267e27d4c498cb4e1b46007b8d5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.187247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b79e267e27d4c498cb4e1b46007b8d5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:13.190234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:13.268963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:13.271301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:13.273799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.275372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.280438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] PATH_INFO: `/v3/projects/0f57a195cc2b47c48190be9cfba8b010` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.291871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b79e267e27d4c498cb4e1b46007b8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.292598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f57a195cc2b47c48190be9cfba8b010)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:13.298802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:13.308705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b79e267e27d4c498cb4e1b46007b8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.321298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b79e267e27d4c498cb4e1b46007b8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.322977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b79e267e27d4c498cb4e1b46007b8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.338188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-37b13f74-fc3f-4cb5-82c3-9d9083723c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b79e267e27d4c498cb4e1b46007b8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.365472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 838/1686] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:12 2022] DELETE /identity/v3/users/2b79e267e27d4c498cb4e1b46007b8d5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:13.366677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf0ac-0f8f-4d73-b4d6-0f48d252bb45 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.367071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf0ac-0f8f-4d73-b4d6-0f48d252bb45 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.367298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf0ac-0f8f-4d73-b4d6-0f48d252bb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.393186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b7caf0ac-0f8f-4d73-b4d6-0f48d252bb45 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:13.394864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7caf0ac-0f8f-4d73-b4d6-0f48d252bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:13.490849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 839/1687] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:13.492405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.492882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.493212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.503776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f57a195cc2b47c48190be9cfba8b010', 'request_id': 'req-ad039a21-b6bb-4255-a775-f80f3c60bc39'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.522696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f57a195cc2b47c48190be9cfba8b010', 'request_id': 'req-ad039a21-b6bb-4255-a775-f80f3c60bc39'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.523833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:13.527886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:13.543408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f57a195cc2b47c48190be9cfba8b010', 'request_id': 'req-ad039a21-b6bb-4255-a775-f80f3c60bc39'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.608801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] The token cache is being invalidate because project 0f57a195cc2b47c48190be9cfba8b010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:13.609281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.612959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ad039a21-b6bb-4255-a775-f80f3c60bc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:13.626688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 849/1688] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:12 2022] DELETE /identity/v3/projects/0f57a195cc2b47c48190be9cfba8b010 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:13.630792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 840/1689] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:13.633048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea9d5-afc7-4803-b668-6cd6d9dc71e1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.633753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea9d5-afc7-4803-b668-6cd6d9dc71e1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.634848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea9d5-afc7-4803-b668-6cd6d9dc71e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.703418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:13.706508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:13.713193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b3dea9d5-afc7-4803-b668-6cd6d9dc71e1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:13.719724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b3dea9d5-afc7-4803-b668-6cd6d9dc71e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:13.761140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 850/1690] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:13.775113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.775616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.776102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.838284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdc549-d3d0-4712-ba2f-4b608a877b14 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:13.843179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:13.845138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:13.845725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:13.846144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:13.862784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:13.864707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:13.875451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:13.904522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 841/1691] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:13.906199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:13.909637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:14.044072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b16d-b316-4c0d-ac91-367a63500e83 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:14.053585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:14.054504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:14.054617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:14.055003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:14.058949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:14.168797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:14.170651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:14.182879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 842/1692] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:24:14.281186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:14.284816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:14.323592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:14.323801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 851/1693] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:14.364044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cab5b-a1f3-45e7-82e5-d06dc5a36373 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:14.404506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:14.405319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:14.411924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:14.412458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:14.413632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:14.414137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:14.422907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:14.500457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 843/1694] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:24:14.505809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:14.538151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa8916-2137-4520-8f8d-f9c24b7d86b9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:14.562777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:14.566806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:14.566806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:14.566806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:14.570816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:14.575185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:14.660928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:14.693394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 852/1695] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:14 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:24:14.702121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:14.735927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902bb9-fded-475b-b750-d2ade8027bd6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:15.042642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:15.049985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.051520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.053260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.060801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:15.070933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:15.095977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:15.099663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:15.140314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8c389-1127-4bb7-98a2-6bc0a3376f90 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:15.144660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 844/1696] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:14 2022] POST /identity/v3/users => generated 286 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:15.152924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:15.173585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:15.180969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.181410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.181712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] PATH_INFO: `/v3/projects/0ef5f0faa6ae4bb680ded0daf7863aaf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.188352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef5f0faa6ae4bb680ded0daf7863aaf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:15.204590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c239dad-a72b-4b07-aa07-fc180d1686a2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:15.204919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:15.212094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:15.215559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.216292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.217281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.218704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:15.224290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:15.262285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 845/1697] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:15.264988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:15.282863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:15.309934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6db07-6e03-471c-80d3-863302495886 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:15.324133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:15.325987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.326525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.327499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.329232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:15.336604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:15.410522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 846/1698] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:15.415271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:15.551413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1df10-fe42-475a-a2c5-4ce61264d638 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:15.578904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef5f0faa6ae4bb680ded0daf7863aaf', 'request_id': 'req-5b47b965-e2e7-43df-9af8-0313f43ae6f2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:15.626594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef5f0faa6ae4bb680ded0daf7863aaf', 'request_id': 'req-5b47b965-e2e7-43df-9af8-0313f43ae6f2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:15.696650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef5f0faa6ae4bb680ded0daf7863aaf', 'request_id': 'req-5b47b965-e2e7-43df-9af8-0313f43ae6f2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:15.763391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b7e2-2c26-4313-9db5-f1987ad226bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:15.764099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b7e2-2c26-4313-9db5-f1987ad226bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.764484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b7e2-2c26-4313-9db5-f1987ad226bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.764907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b7e2-2c26-4313-9db5-f1987ad226bd admin admin] PATH_INFO: `/v3/projects/37ff9235e5ed431bb91367c06efc22b5/users/336b6e02a252451c92bc75ecbc67d445/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.767799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] The token cache is being invalidate because project 0ef5f0faa6ae4bb680ded0daf7863aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:15.768127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:15.769064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:15.773665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 853/1699] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:15 2022] DELETE /identity/v3/projects/0ef5f0faa6ae4bb680ded0daf7863aaf => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:15.779127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:15.781910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:15.811641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b7e2-2c26-4313-9db5-f1987ad226bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ff9235e5ed431bb91367c06efc22b5, user_id=336b6e02a252451c92bc75ecbc67d445, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:15.817439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b965-e2e7-43df-9af8-0313f43ae6f2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:15.824585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b7e2-2c26-4313-9db5-f1987ad226bd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:15.851687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:15.852793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.853876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.854300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] PATH_INFO: `/v3/users/9a83935c63634e34b49b5e4b56280f05` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.856254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a83935c63634e34b49b5e4b56280f05)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:15.859811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:15.870067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 847/1700] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:15 2022] PUT /identity/v3/projects/37ff9235e5ed431bb91367c06efc22b5/users/336b6e02a252451c92bc75ecbc67d445/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:15.899603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:15.900432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:15.901223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:15.998519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] MFA Rules not processed for user `336b6e02a252451c92bc75ecbc67d445`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:16.003545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:16.064689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a83935c63634e34b49b5e4b56280f05'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:16.067473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a83935c63634e34b49b5e4b56280f05'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:16.090923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a83935c63634e34b49b5e4b56280f05'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:16.107833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a83935c63634e34b49b5e4b56280f05'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:16.149822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cc7c3232-7dfa-40b1-9412-9eddb1940e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a83935c63634e34b49b5e4b56280f05'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:16.182309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 854/1701] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:15 2022] DELETE /identity/v3/users/9a83935c63634e34b49b5e4b56280f05 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:16.190086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:16.190789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:16.193434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:16.272490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] MFA Rules not processed for user `1b6e4c96f7054aaeaafebfecdd960467`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:16.283083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:16.291349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 848/1702] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:16.293223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:16.295879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:16.452392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:SELECT=80,keystone:DELETE=17 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:16.505834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 855/1703] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:16.509702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:16.515143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:16.681872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec056dc-1ae8-46c1-b1f8-78f92f9e86d1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:16.724563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:16.778504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a06cb-c94d-4cef-a03d-d85851c079df None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:16.790735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:16.791438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:16.791729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:16.792023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:16.796906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:16.802408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:16.948629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 856/1704] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:16 2022] POST /identity/v3/projects => generated 371 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:16.954078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:16.972338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:17.103585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:17.120773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:17.125554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:17.126326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] PATH_INFO: `/v3/projects/ca361713077a4a76aa473b3a775f0679` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:17.139156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca361713077a4a76aa473b3a775f0679)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:17.165566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:17.398150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd1eca-fc17-4742-934e-371b650e2c86 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:17.430289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca361713077a4a76aa473b3a775f0679', 'request_id': 'req-3d75f16f-6603-4b1b-87e9-782b7f478941'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:17.452586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca361713077a4a76aa473b3a775f0679', 'request_id': 'req-3d75f16f-6603-4b1b-87e9-782b7f478941'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:17.483339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca361713077a4a76aa473b3a775f0679', 'request_id': 'req-3d75f16f-6603-4b1b-87e9-782b7f478941'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:17.536718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] The token cache is being invalidate because project ca361713077a4a76aa473b3a775f0679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:17.537173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:17.538584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:17.545869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 849/1705] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:16 2022] DELETE /identity/v3/projects/ca361713077a4a76aa473b3a775f0679 => generated 0 bytes in 1250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:17.548489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:17.555005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:17.720789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f16f-6603-4b1b-87e9-782b7f478941 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:17.729877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:17.731565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:17.732041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:17.732600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:17.734922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:17.738484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:17.788897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 850/1706] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:17 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:17.790927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:17.794630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:17.801137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:17.851144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:17.854782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:17.862520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:17.862981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:17.867400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:17.935318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7410f-9405-4d1f-a1ca-2c27bce894cf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:17.950805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:17.952367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:17.954135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:17.954750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] PATH_INFO: `/v3/projects/c47393ba3f7c4b8e871e0eba40a7fd19` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:17.958615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47393ba3f7c4b8e871e0eba40a7fd19)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:17.963783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:18.121272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:18.148749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:18.173812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcea7-c58f-4b60-9972-23043af2afab service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:18.214095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 857/1707] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:18.224651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:18.225066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:18.225210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:18.230114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47393ba3f7c4b8e871e0eba40a7fd19', 'request_id': 'req-0cb28102-07f7-4e80-a0bc-d35f189f4c72'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:18.253810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47393ba3f7c4b8e871e0eba40a7fd19', 'request_id': 'req-0cb28102-07f7-4e80-a0bc-d35f189f4c72'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:18.279096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47393ba3f7c4b8e871e0eba40a7fd19', 'request_id': 'req-0cb28102-07f7-4e80-a0bc-d35f189f4c72'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:18.296270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:18.307703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.326045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] The token cache is being invalidate because project c47393ba3f7c4b8e871e0eba40a7fd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:18.326510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:18.328739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cb28102-07f7-4e80-a0bc-d35f189f4c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:18.341911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 851/1708] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:17 2022] DELETE /identity/v3/projects/c47393ba3f7c4b8e871e0eba40a7fd19 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:18.343599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:18.343886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:18.344156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:18.459166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] MFA Rules not processed for user `4a9445ed7a4645af8e578d797e7900da`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:18.464248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.613139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 858/1709] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:18.616671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:18.623598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.664895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc8f8-7a34-4235-b7b3-bc73a49a5c94 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:18.675492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30aa4-cd6e-44eb-8ce1-28054f3e0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:18.676681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30aa4-cd6e-44eb-8ce1-28054f3e0942 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:18.677256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30aa4-cd6e-44eb-8ce1-28054f3e0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:18.677748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30aa4-cd6e-44eb-8ce1-28054f3e0942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:18.679253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30aa4-cd6e-44eb-8ce1-28054f3e0942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:18.685625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30aa4-cd6e-44eb-8ce1-28054f3e0942 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:18.756268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 852/1710] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:18.758002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 859/1711] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:18.760019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006666d8-9a17-4596-9ee0-ffeb6f6a2924 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:18.760559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006666d8-9a17-4596-9ee0-ffeb6f6a2924 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:18.761213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006666d8-9a17-4596-9ee0-ffeb6f6a2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:18.767688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:18.772702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.815276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-006666d8-9a17-4596-9ee0-ffeb6f6a2924 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:18.817378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-006666d8-9a17-4596-9ee0-ffeb6f6a2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.830462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 860/1712] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:18.834116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de10b18-9425-4908-a6a7-dced7de5b423 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:18.839949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:18.840241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:18.840524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:18.845720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:18.847219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:18.847514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:18.849697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] PATH_INFO: `/v3/projects/9e18d55a5dad42c1af7dc8ada5c31b2b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:18.852178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e18d55a5dad42c1af7dc8ada5c31b2b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:18.857517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:18.895037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:18.896574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.930990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 861/1713] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:18.932630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:18.938309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:18.974263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c54f-e109-4709-8f33-c841e7547b13 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:18.998066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e18d55a5dad42c1af7dc8ada5c31b2b', 'request_id': 'req-e65dba97-1d73-4172-9437-f9d607ce1210'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.022791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e18d55a5dad42c1af7dc8ada5c31b2b', 'request_id': 'req-e65dba97-1d73-4172-9437-f9d607ce1210'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.046237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e18d55a5dad42c1af7dc8ada5c31b2b', 'request_id': 'req-e65dba97-1d73-4172-9437-f9d607ce1210'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.091251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] The token cache is being invalidate because project 9e18d55a5dad42c1af7dc8ada5c31b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:19.091547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.106041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.106041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 853/1714] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:18 2022] DELETE /identity/v3/projects/9e18d55a5dad42c1af7dc8ada5c31b2b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:19.106041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:19.110311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:19.202480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:19.209519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:19.211156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.211752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.218587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] PATH_INFO: `/v3/projects/59c70dd71ca74cabbad9180807bff1a1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.221241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c70dd71ca74cabbad9180807bff1a1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:19.225331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:19.299239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:19.319061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dba97-1d73-4172-9437-f9d607ce1210 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:19.342777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f71030-fbe9-46c0-bced-c5590e945795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:19.343893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71030-fbe9-46c0-bced-c5590e945795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.344209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71030-fbe9-46c0-bced-c5590e945795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.344593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71030-fbe9-46c0-bced-c5590e945795 admin admin] PATH_INFO: `/v3/projects/cdf08c9b7de14054985ed371c2231190/users/cee4164f4a95436894504f6b37a4526a/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.384992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f71030-fbe9-46c0-bced-c5590e945795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf08c9b7de14054985ed371c2231190, user_id=cee4164f4a95436894504f6b37a4526a, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:19.388698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f71030-fbe9-46c0-bced-c5590e945795 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:19.417536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c70dd71ca74cabbad9180807bff1a1', 'request_id': 'req-719af7c8-d362-42f8-8f21-ccfcbc052d5e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.421759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 854/1715] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:19 2022] PUT /identity/v3/projects/cdf08c9b7de14054985ed371c2231190/users/cee4164f4a95436894504f6b37a4526a/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:19.426068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.426068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.426068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.443543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c70dd71ca74cabbad9180807bff1a1', 'request_id': 'req-719af7c8-d362-42f8-8f21-ccfcbc052d5e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.461330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c70dd71ca74cabbad9180807bff1a1', 'request_id': 'req-719af7c8-d362-42f8-8f21-ccfcbc052d5e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.484416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] MFA Rules not processed for user `4a9445ed7a4645af8e578d797e7900da`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:19.486881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:19.512647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] The token cache is being invalidate because project 59c70dd71ca74cabbad9180807bff1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:19.512963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.515699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-719af7c8-d362-42f8-8f21-ccfcbc052d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:19.523508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 862/1716] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:18 2022] DELETE /identity/v3/projects/59c70dd71ca74cabbad9180807bff1a1 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:19.524879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3427ec-3dfa-40b8-be8d-c1f72e77b782 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.525167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3427ec-3dfa-40b8-be8d-c1f72e77b782 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.525444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3427ec-3dfa-40b8-be8d-c1f72e77b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.612342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4b3427ec-3dfa-40b8-be8d-c1f72e77b782 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:19.613683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4b3427ec-3dfa-40b8-be8d-c1f72e77b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:19.651300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 855/1717] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:19.652069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:19.653566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:19.853236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21206-c03e-45bf-bed3-7b50e8a2984e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:19.867982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:19.869098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.869502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.869721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.870726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:19.871167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:19.872956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:19.875443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 863/1718] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:19.877245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55a219-714a-4045-ae21-a1044ed0e5e3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.878332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55a219-714a-4045-ae21-a1044ed0e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.878332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55a219-714a-4045-ae21-a1044ed0e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.901134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 856/1719] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:19.902253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:19.906979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:19.929939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6c55a219-714a-4045-ae21-a1044ed0e5e3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:19.931661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6c55a219-714a-4045-ae21-a1044ed0e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:19.938901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675fdd-ca06-4fac-b6b9-3aac211c8bff admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:19.958420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:19.959326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.959683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.960078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.961056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:19.962818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 864/1720] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:19.964876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef062c-fc3a-4eed-9e12-731e96354c40 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:19.965348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef062c-fc3a-4eed-9e12-731e96354c40 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:19.966360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef062c-fc3a-4eed-9e12-731e96354c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:19.972371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:20.006019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 857/1721] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:20.006019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:20.007794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:20.030838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b4ef062c-fc3a-4eed-9e12-731e96354c40 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:20.032681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b4ef062c-fc3a-4eed-9e12-731e96354c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:20.061178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 865/1722] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:20.062803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.063165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.063516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.124710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:20.126240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:20.129528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:20.295126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c90af9-acd8-444f-8224-b04494f26991 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:20.312921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:20.315430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.315722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.316852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.323200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:20.354263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:20.357469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:20.372686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 866/1723] 10.222.0.53 () {58 vars in 1015 bytes} [Fri May 27 03:24:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:20.373857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:20.402538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 858/1724] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:20.403723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:20.420591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d83ca-1db4-449e-92a9-7361829fd094 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:20.432077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ac6c-9444-4597-a413-33496c5cae76 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:20.452440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:20.452703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:20.453459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.453745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.454047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.454198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.454635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.454769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:20.455167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.456906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:20.457354 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:20.457561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:20.467512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a6faa-9d27-49c7-be68-9443958949fd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:20.525374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 867/1725] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:20.533657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.535217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.536302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.558755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 859/1726] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:20 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:20.563890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:20.653385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:20.655543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:20.772457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:20.790652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cda3b-1dde-43cf-a131-949beb199bc8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:20.818513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c412de0-d1cf-4e5b-b835-3eb9f31beaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:20.820919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412de0-d1cf-4e5b-b835-3eb9f31beaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.827009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412de0-d1cf-4e5b-b835-3eb9f31beaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.828072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412de0-d1cf-4e5b-b835-3eb9f31beaf3 admin admin] PATH_INFO: `/v3/projects/cdf08c9b7de14054985ed371c2231190/users/cee4164f4a95436894504f6b37a4526a/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.836281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c412de0-d1cf-4e5b-b835-3eb9f31beaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf08c9b7de14054985ed371c2231190, user_id=cee4164f4a95436894504f6b37a4526a, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:20.857776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c412de0-d1cf-4e5b-b835-3eb9f31beaf3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:20.920651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 860/1727] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:20 2022] PUT /identity/v3/projects/cdf08c9b7de14054985ed371c2231190/users/cee4164f4a95436894504f6b37a4526a/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:20.930514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 868/1728] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:20.930514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:20.931498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:20.931498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:20.931498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:20.931939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:21.003195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:21.010271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:21.200799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eac6b-bb3e-4fa8-b6f3-cb5ac500814b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:21.229264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 861/1729] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:21.236066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:21.261085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596292a-5503-4f38-ba68-00ac1731795f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:21.298735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:21.300322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:21.303048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:21.303556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:21.304468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:21.313814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:21.406396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 862/1730] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:21 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:21.407415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:21.463783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:21.464714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:21.466463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:21.478695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:21.530443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:21.531965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:21.554321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:21.562121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 869/1731] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:21.564314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:21.655875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8ec14-b036-4186-8281-8a063ed2a553 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:21.809787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbccf-1b6f-4894-befd-7e7de3c9e936 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:21.825606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0361b-7950-4844-8bf1-9d1f282d3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:21.831755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0361b-7950-4844-8bf1-9d1f282d3e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:21.835685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0361b-7950-4844-8bf1-9d1f282d3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:21.836174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0361b-7950-4844-8bf1-9d1f282d3e33 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:21.837050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0361b-7950-4844-8bf1-9d1f282d3e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:21.839759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0361b-7950-4844-8bf1-9d1f282d3e33 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:21.914496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 863/1732] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:21 2022] POST /identity/v3/users => generated 284 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:21.916146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:21.918437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:21.922489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:21.952273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:21.963527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:21.963886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:21.964415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:21.965892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:21.966499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:21.970065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:21.998968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] MFA Rules not processed for user `cee4164f4a95436894504f6b37a4526a`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:22.000411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:22.043613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 870/1733] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:22.049763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:22.110812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1104e-6bf3-4416-8635-5b3576ff09af admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:22.159579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 864/1734] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:22.159579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:22.169466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dac14-9ae7-426f-941d-84f2beedfd90 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:22.170381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:22.171546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:22.172439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:22.173033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:22.175319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b68f0-4afb-4112-b4cf-264c84d4dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:22.176159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b68f0-4afb-4112-b4cf-264c84d4dc86 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:22.176533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b68f0-4afb-4112-b4cf-264c84d4dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:22.176910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b68f0-4afb-4112-b4cf-264c84d4dc86 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:22.177812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b68f0-4afb-4112-b4cf-264c84d4dc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:22.182268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:22.192493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:22.198050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:22.203510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b68f0-4afb-4112-b4cf-264c84d4dc86 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:22.308920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 865/1735] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:22 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:22.312099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d499-ecbc-4943-8578-56beffe55f77 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:22.312761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d499-ecbc-4943-8578-56beffe55f77 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:22.313270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d499-ecbc-4943-8578-56beffe55f77 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:22.315210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 866/1736] 10.222.0.61 () {54 vars in 912 bytes} [Fri May 27 03:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:22.317158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d499-ecbc-4943-8578-56beffe55f77 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:22.320271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 871/1737] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:22.323703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:22.349513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d499-ecbc-4943-8578-56beffe55f77 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:22.374295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:22.375680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:22.376182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:22.376965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:22.378263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:22.382722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:22.383068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef6d3f-aff6-401c-ac52-53997d83e795 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:22.405102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:22.406355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:22.411056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:22.411559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:22.417625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:22.428866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 867/1738] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:22.430430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:22.430636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:22.439096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:22.450564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:22.573934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 872/1739] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:22 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:22.576979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:22.636856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3f81c-f6d1-488b-85f3-4d1a6189e22d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:22.684110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:22.950634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:22.957914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:22.959455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:22.962913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.003408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81566-f249-4426-abb4-c48bf03427c7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:23.029718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d70ad-249f-4839-878f-f36e0ae88500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:23.030919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d70ad-249f-4839-878f-f36e0ae88500 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:23.031403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d70ad-249f-4839-878f-f36e0ae88500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:23.036932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d70ad-249f-4839-878f-f36e0ae88500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.044071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d70ad-249f-4839-878f-f36e0ae88500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:23.049301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d70ad-249f-4839-878f-f36e0ae88500 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:23.109753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 873/1740] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:23.115291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:23.115810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:23.116357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.202352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:23.206604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:23.288851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:23.301297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:23.348656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 868/1741] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:23.350268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:23.397494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d5778-7176-4276-bbd2-d4733d40f64c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:23.418509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:23.419048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:23.419667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:23.420165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.422294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:23.432052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:23.462583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 874/1742] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:24:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:23.463860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:23.535717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d9e1b-0f71-44a2-9a78-d7d57311025a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:23.546835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 869/1743] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:23 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:23.550334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:23.552181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:23.553081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:23.553365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:23.553675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.555197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:23.566975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:23.614049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 875/1744] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:23.614049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:23.697085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351b6cb-467d-49a1-b057-0e9591c3c9cd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:23.872047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef766668-26c9-4136-be3d-dff5a93f32f5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:23.891950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:23.893943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:23.894414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:23.894574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.897525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:23.900810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:23.937032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:23.938561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:23.938765 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:23.940629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:23.940629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:23.943195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:23.962272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 870/1745] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:23 2022] POST /identity/v3/users => generated 286 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:23.962272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:23.968290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:23.991962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 876/1746] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:23.991962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:24.019644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981fcb2-1386-4c68-bccb-a47fbb4ac8bc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.037184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:24.037925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.038248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.039538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:24.040097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:24.046463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:24.080027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:24.086725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:24.104430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 877/1747] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:23 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:24.107040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:24.137404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272364-e343-41da-b2f7-46c08b319f6e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.162107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:24.165838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.167072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.167703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:24.193837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:24.200762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:24.229027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 871/1748] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:24.234860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:24.272041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f7f03-7623-4512-bd25-38f6b727aa3f service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.313468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:24.316762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.317229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.318063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] PATH_INFO: `/v3/projects/8cbbe8ff7a334c278adcf7df2504d721/users/482f9bc32ff44a6190fe3700c918fcad/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:24.389748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbbe8ff7a334c278adcf7df2504d721, user_id=482f9bc32ff44a6190fe3700c918fcad, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:24.398184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8eeb5-617d-4f04-ada8-e98950a15071 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.403382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:24.411885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:24.413031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.413725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.414810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:24.418196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:24.457274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 872/1749] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:24 2022] PUT /identity/v3/projects/8cbbe8ff7a334c278adcf7df2504d721/users/482f9bc32ff44a6190fe3700c918fcad/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:24.462233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:24.686273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:24.687907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:24.711973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 878/1750] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:24.712702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:24.713245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02e2b-4e71-4507-bcc8-edab0d5200a5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.735369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77549c92-306b-479c-8e31-d271046e64ec service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.737740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:24.739185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.743299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.743579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:24.744647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:24.745320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d639a5-0782-4557-a5c8-9a65d25db8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:24.747871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d639a5-0782-4557-a5c8-9a65d25db8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.748368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d639a5-0782-4557-a5c8-9a65d25db8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.748819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d639a5-0782-4557-a5c8-9a65d25db8bf admin admin] PATH_INFO: `/v3/projects/1f63f30238384df6b9e21dca8c6eaae4/users/9f3e95d7f00740379dec0f92725f5269/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:24.749260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:24.781632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 873/1751] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:24.782871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:24.804860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d639a5-0782-4557-a5c8-9a65d25db8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f63f30238384df6b9e21dca8c6eaae4, user_id=9f3e95d7f00740379dec0f92725f5269, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:24.822881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d639a5-0782-4557-a5c8-9a65d25db8bf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:24.853357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc2f2-8641-41ea-8248-823be898cbab admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:24.886091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 879/1752] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:24 2022] PUT /identity/v3/projects/1f63f30238384df6b9e21dca8c6eaae4/users/9f3e95d7f00740379dec0f92725f5269/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:24.886091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae3efd-0bfd-401a-be84-1e631ab34af9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:24.886091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae3efd-0bfd-401a-be84-1e631ab34af9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:24.886091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae3efd-0bfd-401a-be84-1e631ab34af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:25.009376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-93ae3efd-0bfd-401a-be84-1e631ab34af9 None None] MFA Rules not processed for user `482f9bc32ff44a6190fe3700c918fcad`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:25.011686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93ae3efd-0bfd-401a-be84-1e631ab34af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:25.153585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:25.156678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:25.157184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:25.159223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:25.160568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:25.164715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:25.236749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 874/1753] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:25.238125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:25.284962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003c470-f987-4b75-a4f1-71715e6155a8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:25.303664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:25.304503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:25.310540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:25.310934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:25.315622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:25.319769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:25.346177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 880/1754] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:25.356059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:25.356760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:25.360128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:25.397831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 875/1755] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:25.402527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:25.440202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affbf64-1022-43ac-9b88-2a0f159a7632 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:25.454299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:25.459245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:25.459855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:25.460141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:25.463404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:25.465179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:25.474962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] MFA Rules not processed for user `9f3e95d7f00740379dec0f92725f5269`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:25.483052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:25.541003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 876/1756] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:25.542689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:25.551625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:25.622587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057d550-1c61-47df-a70f-0fddeba81927 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:25.663002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:25.664050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:25.664609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:25.665113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:25.673763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:25.694315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:25.810466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 877/1757] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:25 2022] POST /identity/v3/projects => generated 367 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:25.811819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:25.834803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:25.932932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 881/1758] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 585 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:25.934658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:25.973994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a5f3-9005-4d9f-8fbc-4eb2a03f157a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:26.182824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:26.187094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.187609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.192653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] PATH_INFO: `/v3/projects/d0aa5b33274f401fb155c688c77ecf40/users/38e7a20e167e45b38764b1ba73038e54/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.208344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747967ec-d006-4e33-aaf8-5eadfc75a580 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:26.229581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:26.232970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.233507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.234059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] PATH_INFO: `/v3/projects/cf521e72be1042cbbaf6a683703f9df4/users/05be91cd387c47dc96ffedd84c58365b/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.270260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0aa5b33274f401fb155c688c77ecf40, user_id=38e7a20e167e45b38764b1ba73038e54, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:26.273901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:26.308827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf521e72be1042cbbaf6a683703f9df4, user_id=05be91cd387c47dc96ffedd84c58365b, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:26.327024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:26.380676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 882/1759] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:25 2022] PUT /identity/v3/projects/d0aa5b33274f401fb155c688c77ecf40/users/38e7a20e167e45b38764b1ba73038e54/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:26.388040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:26.404874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 878/1760] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:25 2022] PUT /identity/v3/projects/cf521e72be1042cbbaf6a683703f9df4/users/05be91cd387c47dc96ffedd84c58365b/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:26.418613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:26.667384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aa9fc-6926-4ce0-9bc1-d8a827b2b9b2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:26.755599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:26.770830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37abb-48f0-49e6-9155-4e82547c5830 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:26.780008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa723ac-7284-49db-962c-6cba86cae8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:26.780724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa723ac-7284-49db-962c-6cba86cae8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.781013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa723ac-7284-49db-962c-6cba86cae8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.781297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa723ac-7284-49db-962c-6cba86cae8bd admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.782055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa723ac-7284-49db-962c-6cba86cae8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:26.794023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa723ac-7284-49db-962c-6cba86cae8bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:26.809472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ba49d-8b9d-4db9-a7a7-f34276345de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:26.810736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba49d-8b9d-4db9-a7a7-f34276345de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.811044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba49d-8b9d-4db9-a7a7-f34276345de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.811519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba49d-8b9d-4db9-a7a7-f34276345de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.814436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba49d-8b9d-4db9-a7a7-f34276345de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:26.825164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba49d-8b9d-4db9-a7a7-f34276345de5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:26.841674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 883/1761] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:26 2022] POST /identity/v3/users => generated 290 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:26.859477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834b566-18a5-4adf-bb5f-efa6739c3401 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.860857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834b566-18a5-4adf-bb5f-efa6739c3401 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.861348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834b566-18a5-4adf-bb5f-efa6739c3401 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.865332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 884/1762] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:24:26 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:26.869500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecb4d-9d2f-4ceb-98f4-8e5bfaf9846e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.870090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecb4d-9d2f-4ceb-98f4-8e5bfaf9846e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.870539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecb4d-9d2f-4ceb-98f4-8e5bfaf9846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.916098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 879/1763] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:26 2022] POST /identity/v3/projects => generated 379 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:26.923780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:26.925890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:26.926367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:26.933527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-531ecb4d-9d2f-4ceb-98f4-8e5bfaf9846e None None] MFA Rules not processed for user `4a9445ed7a4645af8e578d797e7900da`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:26.937764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-531ecb4d-9d2f-4ceb-98f4-8e5bfaf9846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:27.055527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] MFA Rules not processed for user `38e7a20e167e45b38764b1ba73038e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:27.056789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:27.192366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 885/1764] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:27.192366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:27.192366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:27.192805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:27.310198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:27.339017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] MFA Rules not processed for user `05be91cd387c47dc96ffedd84c58365b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:27.342666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 880/1765] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:27.344808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:27.355072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:27.679190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b73e17-503e-40e5-a96b-f1c0c9d826a2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:27.704210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:27.705511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:27.706180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:27.706458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:27.707216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:27.722317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:27.777505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 881/1766] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:27.780456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:27.810816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbd6e3-be6e-4450-a344-f7cba50c26c8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:27.831550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf008b-e01a-4118-bc46-f44f854fed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:27.832228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf008b-e01a-4118-bc46-f44f854fed12 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:27.832558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf008b-e01a-4118-bc46-f44f854fed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:27.832867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf008b-e01a-4118-bc46-f44f854fed12 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:27.833499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf008b-e01a-4118-bc46-f44f854fed12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:27.838987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf008b-e01a-4118-bc46-f44f854fed12 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:27.891696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 882/1767] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:27 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:27.897892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:27.898637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:27.898934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:27.952954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:27.958449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:28.231447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 886/1768] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 1044 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:28.232218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:28.270903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 883/1769] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:24:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:28.271172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:28.272013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41679cd5-6454-4b41-938f-ee6bfa64074e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:28.289698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:28.289934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:28.290447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:28.291732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:28.292489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:28.302286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:28.325299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510f3d-ed66-4532-8927-f06ac93b2588 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:28.369668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:28.371362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:28.371969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:28.372631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] PATH_INFO: `/v3/projects/f68edf99df27417ca75506d5f6e3692a/users/732281abafef43968a9e5d959ae6ccc9/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:28.444359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 887/1770] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:28 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:28.445449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:28.554316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68edf99df27417ca75506d5f6e3692a, user_id=732281abafef43968a9e5d959ae6ccc9, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:28.568249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:28.630587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:28.639616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 884/1771] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:28 2022] PUT /identity/v3/projects/f68edf99df27417ca75506d5f6e3692a/users/732281abafef43968a9e5d959ae6ccc9/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:28.643564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:28.656249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:28.713580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa0c91-ab5a-45d0-83af-68f7600c52e5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:28.866618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:28.868332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:28.873366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:28.887058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:28.889801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:28.911691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:28.941564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 888/1772] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:28.943387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:28.972177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c436b-d592-4409-8c10-26982dbfdb16 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:28.991023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:28.991982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:28.993371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:28.993832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:28.994890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:28.999358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.043001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:29.084692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 889/1773] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:28 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:29.086594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:29.134295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9609-a33e-47e9-84ce-054ad479eeee admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:29.160345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:29.167713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e319be-3260-4d7c-8501-2a2ea86a3357 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:29.168455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:29.168805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:29.169357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:29.171125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:29.178324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.208562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:29.208562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:29.208562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:29.208562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:29.230328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 890/1774] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:29.231321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:29.271746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a542ee-ef68-4c5d-bfc0-2384219cbb9a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:29.297381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:29.299570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:29.302563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:29.303517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] PATH_INFO: `/v3/projects/9f1be26ddcb14df1a5a467f523f69015/users/a1d9d068a3d043249a360e535145e21a/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:29.374965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1be26ddcb14df1a5a467f523f69015, user_id=a1d9d068a3d043249a360e535145e21a, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:29.385873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.419589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:29.421488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.451274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 885/1775] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:29.452469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:29.471477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 891/1776] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:29 2022] PUT /identity/v3/projects/9f1be26ddcb14df1a5a467f523f69015/users/a1d9d068a3d043249a360e535145e21a/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:29.473329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:29.481301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e96b-23a1-4e17-bb96-0cf0e3e72523 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:29.770162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:29.771051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:29.771222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:29.771465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:29.772228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:29.781406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.849390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 886/1777] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:29.852333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:29.855837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c4118-8507-4cc3-947a-b9dba10589ac admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:29.877823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:29.883451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:29.883626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:29.883882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] PATH_INFO: `/v3/projects/f68edf99df27417ca75506d5f6e3692a/users/732281abafef43968a9e5d959ae6ccc9/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:29.897698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6fbb7-1d9b-4a59-aa09-1cc73361b49b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:29.898626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68edf99df27417ca75506d5f6e3692a, user_id=732281abafef43968a9e5d959ae6ccc9, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:29.905546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.924108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155910b-6104-4c9f-919a-5951f22af798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:29.940996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155910b-6104-4c9f-919a-5951f22af798 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:29.941450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155910b-6104-4c9f-919a-5951f22af798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:29.942749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155910b-6104-4c9f-919a-5951f22af798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:29.951119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155910b-6104-4c9f-919a-5951f22af798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:29.969810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155910b-6104-4c9f-919a-5951f22af798 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:29.995331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 892/1778] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:29 2022] PUT /identity/v3/projects/f68edf99df27417ca75506d5f6e3692a/users/732281abafef43968a9e5d959ae6ccc9/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:29.999329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:30.056554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 887/1779] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:30.067865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:30.069340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:30.070012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:30.134523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:30.160194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] MFA Rules not processed for user `1b6e4c96f7054aaeaafebfecdd960467`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:30.170396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:30.321511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9571580-8bba-4560-828a-3725d056a69d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:30.344221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107dd8-e8fd-4efe-9e22-e8f8b5dc3476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:30.347394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107dd8-e8fd-4efe-9e22-e8f8b5dc3476 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:30.347924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107dd8-e8fd-4efe-9e22-e8f8b5dc3476 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:30.348485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107dd8-e8fd-4efe-9e22-e8f8b5dc3476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:30.381381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107dd8-e8fd-4efe-9e22-e8f8b5dc3476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:30.385187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107dd8-e8fd-4efe-9e22-e8f8b5dc3476 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:30.519416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 888/1780] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:30.521870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:30.523609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 893/1781] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:30.529073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:30.529561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:30.530036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:30.567138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:30.654669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] MFA Rules not processed for user `732281abafef43968a9e5d959ae6ccc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:30.657700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:30.726674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96192-2daf-4db5-b2e7-c3bf1fa65749 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:30.741070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:30.743871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:30.743871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:30.744248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] PATH_INFO: `/v3/projects/1600ea5e96464c9c8f21a2fe2afcd43e/users/5885d97606624a69b3854cc79b269f16/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:30.822362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1600ea5e96464c9c8f21a2fe2afcd43e, user_id=5885d97606624a69b3854cc79b269f16, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:30.835130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:30.877924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 889/1782] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:30 2022] PUT /identity/v3/projects/1600ea5e96464c9c8f21a2fe2afcd43e/users/5885d97606624a69b3854cc79b269f16/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:30.883798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:30.895300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 894/1783] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:30.896363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:30.916736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f93e66-8ae2-49e7-af25-30618c603d0b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:31.043633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1d83-c54e-4f7d-b597-0a60b0073fc7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:31.051135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:31.052074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.052392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.052638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] PATH_INFO: `/v3/projects/9f1be26ddcb14df1a5a467f523f69015/users/a1d9d068a3d043249a360e535145e21a/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.054969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1be26ddcb14df1a5a467f523f69015, user_id=a1d9d068a3d043249a360e535145e21a, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:31.057850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:31.075491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170867-e005-457a-ad79-f80f40f91d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:31.076319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170867-e005-457a-ad79-f80f40f91d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.076687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170867-e005-457a-ad79-f80f40f91d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.080511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170867-e005-457a-ad79-f80f40f91d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.081803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170867-e005-457a-ad79-f80f40f91d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:31.085685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 890/1784] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:30 2022] PUT /identity/v3/projects/9f1be26ddcb14df1a5a467f523f69015/users/a1d9d068a3d043249a360e535145e21a/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:31.085685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:31.086090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170867-e005-457a-ad79-f80f40f91d1d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:31.087679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:31.098960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 895/1785] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:31.103453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.103799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.104023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.139961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] MFA Rules not processed for user `a1d9d068a3d043249a360e535145e21a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:31.141327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:31.171358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:31.210719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c067c-e614-45f8-9837-6a5a72d697f3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:31.217647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:31.219736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.220474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.221297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.269199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 896/1786] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:31.270831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:31.315086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:31.348430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:31.351379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:31.368869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5547-8db0-4223-aab2-d42c9ece8745 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:31.374707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 891/1787] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:31.375919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf66e-8707-4764-af5b-64974b13cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:31.376280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:31.378157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf66e-8707-4764-af5b-64974b13cd63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.378847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf66e-8707-4764-af5b-64974b13cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.379231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf66e-8707-4764-af5b-64974b13cd63 admin admin] PATH_INFO: `/v3/projects/1600ea5e96464c9c8f21a2fe2afcd43e/users/5885d97606624a69b3854cc79b269f16/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.381852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaf66e-8707-4764-af5b-64974b13cd63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1600ea5e96464c9c8f21a2fe2afcd43e, user_id=5885d97606624a69b3854cc79b269f16, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:31.385428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaf66e-8707-4764-af5b-64974b13cd63 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:31.392234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4fa5-6560-435c-a3c2-7e24f600a19c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:31.399375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:31.400563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.401075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.401560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.404705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 897/1788] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:31 2022] PUT /identity/v3/projects/1600ea5e96464c9c8f21a2fe2afcd43e/users/5885d97606624a69b3854cc79b269f16/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:31.422886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:31.424966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.425477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.425910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.426118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:31.447124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 892/1789] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:31.478631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] MFA Rules not processed for user `5885d97606624a69b3854cc79b269f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:31.480904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:31.644711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 898/1790] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:31.674495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:31.686672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c401d6f-f262-44f4-93a5-bc4af11e6c77 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:31.785773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14ddd5-ba91-438b-ac07-d8d388e51ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:31.787657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ddd5-ba91-438b-ac07-d8d388e51ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:31.788429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ddd5-ba91-438b-ac07-d8d388e51ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:31.789475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ddd5-ba91-438b-ac07-d8d388e51ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:31.806306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14ddd5-ba91-438b-ac07-d8d388e51ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:31.809465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14ddd5-ba91-438b-ac07-d8d388e51ceb service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:31.831279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 893/1791] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:32.044259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:32.146517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:32.250947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e643cf-a7fd-440a-a904-bce437bca0a4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:32.264617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:32.267691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:32.268220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:32.273461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] PATH_INFO: `/v3/users/38e7a20e167e45b38764b1ba73038e54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:32.277589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e7a20e167e45b38764b1ba73038e54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:32.280869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:32.403954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e7a20e167e45b38764b1ba73038e54'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:32.406170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e7a20e167e45b38764b1ba73038e54'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:32.438058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e7a20e167e45b38764b1ba73038e54'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:32.457414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e7a20e167e45b38764b1ba73038e54'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:32.483050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e7a20e167e45b38764b1ba73038e54'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:32.495628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 899/1792] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:32 2022] DELETE /identity/v3/users/38e7a20e167e45b38764b1ba73038e54 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:32.501036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:32.501992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:32.502345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:32.555779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:32.559258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:32.690732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 894/1793] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:32.708502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:32.710953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:32.862710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cadea-5e78-43d6-a831-736b4bb90d3e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:32.883795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8800318-9ee3-4e26-b7b8-7510a0ba2244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:32.884604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8800318-9ee3-4e26-b7b8-7510a0ba2244 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:32.884857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8800318-9ee3-4e26-b7b8-7510a0ba2244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:32.885137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8800318-9ee3-4e26-b7b8-7510a0ba2244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:32.913188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8800318-9ee3-4e26-b7b8-7510a0ba2244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:32.915044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8800318-9ee3-4e26-b7b8-7510a0ba2244 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:32.931673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 900/1794] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:33.266099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:33.270013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:33.330250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4074c-e82f-4a00-864b-f141f4b90de0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:33.346707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:33.347728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:33.348073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:33.348396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] PATH_INFO: `/v3/users/9f3e95d7f00740379dec0f92725f5269` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:33.354188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3e95d7f00740379dec0f92725f5269)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:33.363178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:33.622375 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3e95d7f00740379dec0f92725f5269'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:33.718308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3e95d7f00740379dec0f92725f5269'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:33.722333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:33.748171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3e95d7f00740379dec0f92725f5269'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:33.749313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3e95d7f00740379dec0f92725f5269'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:33.781884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3e95d7f00740379dec0f92725f5269'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:33.791443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 895/1795] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:33 2022] DELETE /identity/v3/users/9f3e95d7f00740379dec0f92725f5269 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:33.796464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:33.797024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:33.797024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:33.822716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:33.824866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:33.870290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:33.871990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:33.937515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:33.976962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50b37-89e8-41ef-91dd-a54754b46101 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:33.980382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 901/1796] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:33.986590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:33.987453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:33.989230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:33.989532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:33.989684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:33.991466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] PATH_INFO: `/v3/projects/d0aa5b33274f401fb155c688c77ecf40` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:33.994484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0aa5b33274f401fb155c688c77ecf40)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:33.996695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:34.093681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96715a6d-9bf7-4b1a-8a90-5c2b711927ff None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:34.121583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0aa5b33274f401fb155c688c77ecf40', 'request_id': 'req-a3b8c371-d210-44fe-b882-ca19920269f0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.144136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0aa5b33274f401fb155c688c77ecf40', 'request_id': 'req-a3b8c371-d210-44fe-b882-ca19920269f0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.180523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0aa5b33274f401fb155c688c77ecf40', 'request_id': 'req-a3b8c371-d210-44fe-b882-ca19920269f0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.188465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:34.190260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:34.190764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:34.191241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:34.307248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] The token cache is being invalidate because project d0aa5b33274f401fb155c688c77ecf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:34.307248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.307816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.315173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 896/1797] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:33 2022] DELETE /identity/v3/projects/d0aa5b33274f401fb155c688c77ecf40 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:34.325281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:34.328716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:34.373272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:34.374805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:34.392867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 902/1798] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:34.421293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8c371-d210-44fe-b882-ca19920269f0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:34.427850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:34.429589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:34.430232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:34.430750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] PATH_INFO: `/v3/users/5885d97606624a69b3854cc79b269f16` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:34.433130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5885d97606624a69b3854cc79b269f16)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:34.437819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:34.463869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:34.519910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5885d97606624a69b3854cc79b269f16'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.541585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5885d97606624a69b3854cc79b269f16'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.558483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5885d97606624a69b3854cc79b269f16'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.559546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5885d97606624a69b3854cc79b269f16'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.571896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5885d97606624a69b3854cc79b269f16'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:34.584804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 897/1799] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:34 2022] DELETE /identity/v3/users/5885d97606624a69b3854cc79b269f16 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:34.648771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:34.648771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:34.681582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a423a-459f-455e-8822-22656341dc87 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:34.870103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:34.875085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:34.875980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:34.877674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] PATH_INFO: `/v3/users/05be91cd387c47dc96ffedd84c58365b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:34.881367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05be91cd387c47dc96ffedd84c58365b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:34.888039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:34.903435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:35.091221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05be91cd387c47dc96ffedd84c58365b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.092480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05be91cd387c47dc96ffedd84c58365b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.126456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05be91cd387c47dc96ffedd84c58365b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.136989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:35.140185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:35.153371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05be91cd387c47dc96ffedd84c58365b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.165915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55511dc7-ab52-484a-a0d7-513312f09747 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:35.174590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:35.175765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:35.176349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:35.176839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] PATH_INFO: `/v3/projects/1f63f30238384df6b9e21dca8c6eaae4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:35.178660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f63f30238384df6b9e21dca8c6eaae4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:35.181125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:35.188063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-536cfca4-c79d-49cc-9269-a2f32d0aaf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05be91cd387c47dc96ffedd84c58365b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.223962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 903/1800] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:34 2022] DELETE /identity/v3/users/05be91cd387c47dc96ffedd84c58365b => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:35.228209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:35.228505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:35.228783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:35.271273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:35.289203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:35.338290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f63f30238384df6b9e21dca8c6eaae4', 'request_id': 'req-c6bd406e-8f52-4607-b095-86048c6fb0b7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.360597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f63f30238384df6b9e21dca8c6eaae4', 'request_id': 'req-c6bd406e-8f52-4607-b095-86048c6fb0b7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.391187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f63f30238384df6b9e21dca8c6eaae4', 'request_id': 'req-c6bd406e-8f52-4607-b095-86048c6fb0b7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.425467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] The token cache is being invalidate because project 1f63f30238384df6b9e21dca8c6eaae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:35.425833 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.427715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.431550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 898/1801] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:35 2022] DELETE /identity/v3/projects/1f63f30238384df6b9e21dca8c6eaae4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:35.437845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:35.441269 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:35.501686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 904/1802] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:35.511760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:35.513768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:35.539509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88799f21-0b0d-4481-b0ea-8ca46fb16348 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:35.583636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:35.590141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:35.590512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:35.590755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] PATH_INFO: `/v3/projects/1600ea5e96464c9c8f21a2fe2afcd43e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:35.596165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1600ea5e96464c9c8f21a2fe2afcd43e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:35.604400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:35.653801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd406e-8f52-4607-b095-86048c6fb0b7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:35.671131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:35.672285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:35.672622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:35.673874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] PATH_INFO: `/v3/users/a1d9d068a3d043249a360e535145e21a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:35.676254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d9d068a3d043249a360e535145e21a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:35.684574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:35.730883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1600ea5e96464c9c8f21a2fe2afcd43e', 'request_id': 'req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.735454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:35.748553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1600ea5e96464c9c8f21a2fe2afcd43e', 'request_id': 'req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.768293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1600ea5e96464c9c8f21a2fe2afcd43e', 'request_id': 'req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.823459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] The token cache is being invalidate because project 1600ea5e96464c9c8f21a2fe2afcd43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:35.828401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.832407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.853511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 905/1803] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:35 2022] DELETE /identity/v3/projects/1600ea5e96464c9c8f21a2fe2afcd43e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:35.853511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:35.858301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d9d068a3d043249a360e535145e21a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.859406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:35.916963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:35.930950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d9d068a3d043249a360e535145e21a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.965407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d9d068a3d043249a360e535145e21a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:35.967633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d9d068a3d043249a360e535145e21a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.018486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d9d068a3d043249a360e535145e21a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.064537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0f0f-6eea-4385-843e-b78de1a1b4b3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:36.070861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 899/1804] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:35 2022] DELETE /identity/v3/users/a1d9d068a3d043249a360e535145e21a => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:36.081829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:36.082760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.083019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.083307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.083572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:36.088379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:36.091292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:36.250720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:36.252226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55e29d-8c81-49b4-9275-a552119646f9 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:36.278461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 906/1805] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:36.280052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b525b-cc55-4e6f-a7f8-4d8a96f98b5f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.280325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b525b-cc55-4e6f-a7f8-4d8a96f98b5f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.280668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b525b-cc55-4e6f-a7f8-4d8a96f98b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.323195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a86b525b-cc55-4e6f-a7f8-4d8a96f98b5f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:36.327706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a86b525b-cc55-4e6f-a7f8-4d8a96f98b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:36.525683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 907/1806] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:36.538659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.539240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.539835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.588926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd3b6b-bfe5-4ac1-9eb3-4a2e3b1fbded admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:36.600208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:36.606979 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:36.624453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:36.626012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.626305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.626777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] PATH_INFO: `/v3/users/482f9bc32ff44a6190fe3700c918fcad` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.628193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482f9bc32ff44a6190fe3700c918fcad)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:36.630229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:36.681166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 908/1807] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:36.683842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:36.725852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a9569-88d2-433f-9c7b-bb3af09c9641 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:36.745611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:36.746851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.747344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.748474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.749230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:36.749777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:36.754826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:36.776227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482f9bc32ff44a6190fe3700c918fcad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.790832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 909/1808] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:36.793372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:36.813294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482f9bc32ff44a6190fe3700c918fcad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.822704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ecd3e-2b07-4e08-ba23-5a4596fc3909 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:36.840533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482f9bc32ff44a6190fe3700c918fcad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.841594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482f9bc32ff44a6190fe3700c918fcad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.845398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:36.846605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.847358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.847657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.849167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:36.855277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:36.878471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5fa0bf21-2856-40ab-8d1b-34edd72e3602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482f9bc32ff44a6190fe3700c918fcad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:36.896529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 900/1809] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:36 2022] DELETE /identity/v3/users/482f9bc32ff44a6190fe3700c918fcad => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:36.903307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3658c-3267-484a-8365-3c933888f39f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:36.904119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3658c-3267-484a-8365-3c933888f39f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:36.904754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3658c-3267-484a-8365-3c933888f39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:36.985918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 910/1810] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:36 2022] POST /identity/v3/projects => generated 391 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:36.990194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:36.996290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:37.000599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-45d3658c-3267-484a-8365-3c933888f39f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:37.003184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45d3658c-3267-484a-8365-3c933888f39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:37.090284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:37.152974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:37.274049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88e25-f07a-4352-98b0-acd8e70919b1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:37.326706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:37.333539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:37.342076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:37.344009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:37.347648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:37.359828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:37.367459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 901/1811] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:37.414050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 911/1812] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:36 2022] POST /identity/v3/users => generated 296 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:37.419602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3658c-3267-484a-8365-3c933888f39f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:37.430845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:37.435750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:37.452782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3658c-3267-484a-8365-3c933888f39f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:37.514154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:37.515761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:37.516383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:37.517623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:37.521369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:37.531606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:37.612644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 902/1813] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:37.621054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:37.669149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e6924-0617-4fb4-a989-bdb3348e4da3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:37.706860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:37.707716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:37.708099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:37.708464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:37.709329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:37.711863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:37.758837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 903/1814] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:37.765619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:37.801292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396334c-b7f8-4222-9f56-9c20832cfba7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:37.817680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec083a-5b06-45f6-8936-7aa813a351a9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:37.828425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19462d4d-678f-48a3-805b-c01c71b6aecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:37.831071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19462d4d-678f-48a3-805b-c01c71b6aecb service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:37.831257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:37.831553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19462d4d-678f-48a3-805b-c01c71b6aecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:37.832022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19462d4d-678f-48a3-805b-c01c71b6aecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:37.832418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:37.832823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:37.833876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] PATH_INFO: `/v3/projects/99624fbcaabf4278a48c92ea56021c89/users/44eeef3290944185a90499cb651748a0/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:37.854577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19462d4d-678f-48a3-805b-c01c71b6aecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:37.858594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19462d4d-678f-48a3-805b-c01c71b6aecb service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:37.881651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99624fbcaabf4278a48c92ea56021c89, user_id=44eeef3290944185a90499cb651748a0, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:37.882928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 912/1815] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:37.884960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:37.937579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 904/1816] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:37 2022] PUT /identity/v3/projects/99624fbcaabf4278a48c92ea56021c89/users/44eeef3290944185a90499cb651748a0/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:37.942100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:37.942404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:37.942912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:38.068782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] MFA Rules not processed for user `44eeef3290944185a90499cb651748a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:38.075177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:38.089020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:38.099586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:38.332795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbcaf-e6c7-48ae-a852-3fed216a6e8d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:38.338180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 913/1817] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:38.344971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:38.353681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:38.356564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:38.358505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:38.359077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] PATH_INFO: `/v3/projects/cf521e72be1042cbbaf6a683703f9df4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:38.362691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf521e72be1042cbbaf6a683703f9df4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:38.369096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:38.378344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a62a9-4a2e-45ea-87b4-713b31fcfea3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:38.408656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:38.410332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:38.410988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:38.412490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:38.418877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:38.432627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:38.513013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf521e72be1042cbbaf6a683703f9df4', 'request_id': 'req-c0bfea5f-15bb-409a-b670-fbf912c44014'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:38.530788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf521e72be1042cbbaf6a683703f9df4', 'request_id': 'req-c0bfea5f-15bb-409a-b670-fbf912c44014'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:38.545001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf521e72be1042cbbaf6a683703f9df4', 'request_id': 'req-c0bfea5f-15bb-409a-b670-fbf912c44014'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:38.571570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:38.593182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] The token cache is being invalidate because project cf521e72be1042cbbaf6a683703f9df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:38.594678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:38.600263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c0bfea5f-15bb-409a-b670-fbf912c44014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:38.611522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 905/1818] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:38 2022] DELETE /identity/v3/projects/cf521e72be1042cbbaf6a683703f9df4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:38.614529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355441c-1c37-49fb-b09e-60ad6679559c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:38.617734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 914/1819] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:38 2022] POST /identity/v3/projects => generated 393 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:38.620070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355441c-1c37-49fb-b09e-60ad6679559c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:38.620877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355441c-1c37-49fb-b09e-60ad6679559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:38.627319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:38.635610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:38.712519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4355441c-1c37-49fb-b09e-60ad6679559c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:38.718390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4355441c-1c37-49fb-b09e-60ad6679559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:38.720494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:38.947688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309904-a117-4e0a-8b1e-e3356b7bc801 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:38.981792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:38.987252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:38.987937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:38.991642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.005056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.005526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 906/1820] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:39.005746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.014045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.014749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.015370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.090015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 915/1821] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:38 2022] POST /identity/v3/users => generated 303 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:39.091976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:39.094788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:39.096701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.136208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 907/1822] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:39.139074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eab04-a3bb-4a76-a2eb-175794cf55c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.144157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.165426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8303f-9ed5-4b20-8ae5-62a700f86b5a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.167111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.172662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.173746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.177076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.178688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.179337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.179890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.180897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.182169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:39.182471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.182892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.185756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.186638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.207687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 916/1823] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:39.212792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.225349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 908/1824] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:24:39.231838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.259215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9bc18-4207-4d62-b5d9-827bea92db98 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.260433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6c8c4-b62c-409b-9fb4-52ce03590a15 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.281796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.283887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.284259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.284415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.284948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.285749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.286251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.286357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.286706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] PATH_INFO: `/v3/projects/002becc5f264479f88d3c8d987496124/users/b2a40ce3991a44829fb29187b460c8d5/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.296065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.342932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002becc5f264479f88d3c8d987496124, user_id=b2a40ce3991a44829fb29187b460c8d5, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.353108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.394283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 909/1825] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:39 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:39.410146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.434475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 917/1826] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:39 2022] PUT /identity/v3/projects/002becc5f264479f88d3c8d987496124/users/b2a40ce3991a44829fb29187b460c8d5/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:39.436468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.445394 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:39.744168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d948e-1e14-4b00-9222-a0808335769b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.755562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.757517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.758560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.759213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.760953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.767620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.815881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 910/1827] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:39 2022] POST /identity/v3/users => generated 288 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:39.818398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.845474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a668a9-cf74-499b-bdee-d7c20a31d599 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.856487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606289-9ca6-40ce-945a-55e4ff34f807 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.863025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.865425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.867812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.870609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.875720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.882531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.883104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.887357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.892484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.894779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] PATH_INFO: `/v3/projects/9f1be26ddcb14df1a5a467f523f69015` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.926730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 911/1828] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:39.927746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:39.935755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1be26ddcb14df1a5a467f523f69015)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:39.949150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:39.969137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb11c6-8427-4b71-bbc9-6f87ed7bd6ee admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:39.983441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:39.984782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:39.987429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:39.987964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:39.993249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:40.002040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:40.039661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 912/1829] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:40.039661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:40.054348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa921-5754-40e9-907c-bbf6dbb53cbd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:40.076298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:40.077781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.077781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.077781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] PATH_INFO: `/v3/projects/002becc5f264479f88d3c8d987496124/users/b2a40ce3991a44829fb29187b460c8d5/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.084775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002becc5f264479f88d3c8d987496124, user_id=b2a40ce3991a44829fb29187b460c8d5, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:40.088113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:40.115830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1be26ddcb14df1a5a467f523f69015', 'request_id': 'req-4638c296-a4ad-4f9e-8687-41aca71518d8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.146769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1be26ddcb14df1a5a467f523f69015', 'request_id': 'req-4638c296-a4ad-4f9e-8687-41aca71518d8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.150529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 913/1830] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:40 2022] PUT /identity/v3/projects/002becc5f264479f88d3c8d987496124/users/b2a40ce3991a44829fb29187b460c8d5/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:40.163912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:40.165346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.177287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1be26ddcb14df1a5a467f523f69015', 'request_id': 'req-4638c296-a4ad-4f9e-8687-41aca71518d8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.204156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:40.208227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] The token cache is being invalidate because project 9f1be26ddcb14df1a5a467f523f69015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:40.208860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.215777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.230721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 918/1831] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:39 2022] DELETE /identity/v3/projects/9f1be26ddcb14df1a5a467f523f69015 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:40.234588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:40.239884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.259010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:40.328847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bb910-6a6b-4168-8bed-1bb64ec7bc39 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:40.348650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:40.349677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.350186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.351016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] PATH_INFO: `/v3/projects/8cbbe8ff7a334c278adcf7df2504d721` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.352157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbbe8ff7a334c278adcf7df2504d721)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:40.354253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:40.418678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c296-a4ad-4f9e-8687-41aca71518d8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:40.431575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146d9e7-0535-4445-8cca-bc477156a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:40.432652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d9e7-0535-4445-8cca-bc477156a36e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.433149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d9e7-0535-4445-8cca-bc477156a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.433679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d9e7-0535-4445-8cca-bc477156a36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.434597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146d9e7-0535-4445-8cca-bc477156a36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:40.440236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146d9e7-0535-4445-8cca-bc477156a36e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:40.463921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 919/1832] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:40.465498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.467418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.469745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.485695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbbe8ff7a334c278adcf7df2504d721', 'request_id': 'req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.498495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbbe8ff7a334c278adcf7df2504d721', 'request_id': 'req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.511857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbbe8ff7a334c278adcf7df2504d721', 'request_id': 'req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.520617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] MFA Rules not processed for user `b2a40ce3991a44829fb29187b460c8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:40.522512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.535431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] The token cache is being invalidate because project 8cbbe8ff7a334c278adcf7df2504d721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:40.535726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.536504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a5338ef4-5bdf-4815-a096-7efcc1b7a8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.539639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 914/1833] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:40 2022] DELETE /identity/v3/projects/8cbbe8ff7a334c278adcf7df2504d721 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:40.548240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.548528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.548815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.596387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:40.598281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.702405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 920/1834] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:40.703465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:40.705150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.769413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 915/1835] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:40.770556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:40.772082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.806687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83451-c47f-476f-82fa-314bf6b4400f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:40.823568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:40.826961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.834764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.835654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] PATH_INFO: `/v3/users/732281abafef43968a9e5d959ae6ccc9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.838822 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=732281abafef43968a9e5d959ae6ccc9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:40.851092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:40.873130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8768f8-14f1-47a4-80fe-5d1d6c4f5427 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:40.881000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb6b14-4e83-489e-b695-66e62b8c6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:40.882278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6b14-4e83-489e-b695-66e62b8c6324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.882720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6b14-4e83-489e-b695-66e62b8c6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.883173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6b14-4e83-489e-b695-66e62b8c6324 admin admin] PATH_INFO: `/v3/projects/34300e1c3e0140518efe861f9d713b55/users/ffecfe924bda44cc8e83e7ecc0e452db/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.903221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb6b14-4e83-489e-b695-66e62b8c6324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34300e1c3e0140518efe861f9d713b55, user_id=ffecfe924bda44cc8e83e7ecc0e452db, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:40.906920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb6b14-4e83-489e-b695-66e62b8c6324 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:40.927643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 921/1836] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:40 2022] PUT /identity/v3/projects/34300e1c3e0140518efe861f9d713b55/users/ffecfe924bda44cc8e83e7ecc0e452db/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:40.928582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:40.930477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6026-ef9d-442e-a82b-3594c34a09d9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:40.930770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6026-ef9d-442e-a82b-3594c34a09d9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:40.931180 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6026-ef9d-442e-a82b-3594c34a09d9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:40.932931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 922/1837] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:24:40.934120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6026-ef9d-442e-a82b-3594c34a09d9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:40.940449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-20cf6026-ef9d-442e-a82b-3594c34a09d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:40.960095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732281abafef43968a9e5d959ae6ccc9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:40.975865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:41.002720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732281abafef43968a9e5d959ae6ccc9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:41.025630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732281abafef43968a9e5d959ae6ccc9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:41.026485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732281abafef43968a9e5d959ae6ccc9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:41.039781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de887999-80eb-49fd-8f82-1224d63287cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732281abafef43968a9e5d959ae6ccc9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:41.059215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 916/1838] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:40 2022] DELETE /identity/v3/users/732281abafef43968a9e5d959ae6ccc9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:41.059215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf388c0-8176-492e-9dc2-9d3154c66bde None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.059215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf388c0-8176-492e-9dc2-9d3154c66bde None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.059215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf388c0-8176-492e-9dc2-9d3154c66bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.097176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6026-ef9d-442e-a82b-3594c34a09d9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.106094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-abf388c0-8176-492e-9dc2-9d3154c66bde None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:41.108097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-abf388c0-8176-492e-9dc2-9d3154c66bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.270228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.271205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.271625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.272051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.280469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.349227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 917/1839] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:41.351440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.351963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.352851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.436778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:41.438297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b55d3-f8e1-496f-8474-52848e08f371 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:41.450755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] MFA Rules not processed for user `ffecfe924bda44cc8e83e7ecc0e452db`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:41.453450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.463639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 923/1840] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:41.466369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.467080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.467080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.544638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:41.554590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.653490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 918/1841] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:41.653490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.689859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad43f7-42f5-4447-9199-fb58422b2339 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.702929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 924/1842] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:24:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:41.704031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.705665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.709335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.712257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.713546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.714264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.716846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:41.718650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:41.719668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:41.725146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cdd43-8ec2-43cc-8433-26c8b095d559 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.733536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.734295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.734840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.735117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.739122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.755275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:41.787310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 919/1843] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:41.789313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.794145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.840567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28c5f4-4335-49b8-8901-333f009f95bd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.847349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.848331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.848646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.848929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.864594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:41.867337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:41.869903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:41.871570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:41.886759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 925/1844] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:41.888072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.898379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 920/1845] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:41.899496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.901613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.913689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f076629-3fad-482b-a9dc-4f7200e5d332 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.920656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7571f4-612c-47e5-88f7-992ef0d18a95 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.921037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.921950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.922465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.923622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.924525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:41.927223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.927597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:41.927899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.928184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.928458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:41.942635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:41.944241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:41.959594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 921/1846] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:41.960441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.963027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:41.975977 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:41.983625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c0522-30ed-4fe2-816e-64dc5511b81b service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:41.993370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 926/1847] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:41 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:41.995716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:41.996790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:41.997819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:41.998726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:41.999013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] PATH_INFO: `/v3/projects/f68edf99df27417ca75506d5f6e3692a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.002463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68edf99df27417ca75506d5f6e3692a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.013932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.165065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68edf99df27417ca75506d5f6e3692a', 'request_id': 'req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.173691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8e18-20a9-441c-b2bf-27a488a19654 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.174843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68edf99df27417ca75506d5f6e3692a', 'request_id': 'req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.193510 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68edf99df27417ca75506d5f6e3692a', 'request_id': 'req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.223298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] The token cache is being invalidate because project f68edf99df27417ca75506d5f6e3692a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:42.223598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.224707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a3a257ff-cd4a-43bb-a4f1-1cbbc8e8e29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.228959 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 922/1848] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:41 2022] DELETE /identity/v3/projects/f68edf99df27417ca75506d5f6e3692a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:42.236952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.237446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.237728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.281609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:42.292181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.309359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.310144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.310464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.310755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.311457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.313533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.348102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 927/1849] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:41 2022] POST /identity/v3/users => generated 292 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:42.349266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.353828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.377927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe52ce-1700-4d02-8d34-31b9faba9ca0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.394144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.395387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.395960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.397056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.398647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.404586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.433090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 928/1850] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:42.434987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.451376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 923/1851] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:42.452261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.459292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.472326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040aa80f-ed2b-4afa-ab4a-e2b33447c77f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.480518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dab36c-10e9-4ecf-8daa-dc7d20eee8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.481229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dab36c-10e9-4ecf-8daa-dc7d20eee8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.481561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dab36c-10e9-4ecf-8daa-dc7d20eee8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.481842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dab36c-10e9-4ecf-8daa-dc7d20eee8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.482707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dab36c-10e9-4ecf-8daa-dc7d20eee8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.484400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dab36c-10e9-4ecf-8daa-dc7d20eee8e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.496820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdbc0-1171-4e20-8533-d875acbf0b14 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.502198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 924/1852] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:42.504138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.504637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.505113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.509926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.511789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.512252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.512749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] PATH_INFO: `/v3/users/ffecfe924bda44cc8e83e7ecc0e452db` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.515134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffecfe924bda44cc8e83e7ecc0e452db)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.520619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.526168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:42.551706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:42.552980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.562349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 925/1853] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:42.567866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.573856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae216-eaac-4b0f-a425-0f7ec750f154 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.580755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.581799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.582125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.582453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] PATH_INFO: `/v3/projects/955f5a89aca3474f9048874e5fa24d9f/users/ff386fbce7414511ae5f79f0e300a00e/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.601115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955f5a89aca3474f9048874e5fa24d9f, user_id=ff386fbce7414511ae5f79f0e300a00e, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.604346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.626117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 926/1854] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:42 2022] PUT /identity/v3/projects/955f5a89aca3474f9048874e5fa24d9f/users/ff386fbce7414511ae5f79f0e300a00e/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:42.626117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.636470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffecfe924bda44cc8e83e7ecc0e452db'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.637592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffecfe924bda44cc8e83e7ecc0e452db'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.652114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffecfe924bda44cc8e83e7ecc0e452db'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.665390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffecfe924bda44cc8e83e7ecc0e452db'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.695142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2ce33d86-0c97-437c-9096-8798d85b6090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffecfe924bda44cc8e83e7ecc0e452db'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:42.695260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:42.702778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 929/1855] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:42 2022] DELETE /identity/v3/users/ffecfe924bda44cc8e83e7ecc0e452db => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:42.703974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.704782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.705095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.717574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb75a68-daf7-41ef-ad1a-02659243fbb4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.741067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] MFA Rules not processed for user `ff386fbce7414511ae5f79f0e300a00e`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:42.742564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.791262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.791978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.792382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.792664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.793415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:42.793727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.795434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47130-b0b4-4e13-872d-ff10b5a758c2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.809270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 927/1856] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:42.810663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.812960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.812960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.841523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 930/1857] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:42.843459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:42.843862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.845281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.850166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.865286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 928/1858] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:42.865286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:42.866771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:42.880553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c35b8-4944-4309-bbb0-9d639eb9acd2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.894238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.895907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.896718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.897501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:42.899327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:42.903500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:42.983300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d1e3-2cd9-41c9-b80b-bc9aac2fd0c5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:42.995063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:42.997696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:42.998624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:42.999606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.023459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 931/1859] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:42 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:43.025225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:43.029307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:43.043240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:43.054972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:43.117702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 929/1860] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:43.120968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:43.180176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:43.191170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d46f0-966e-40c5-84ca-05eeb87795bc service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:43.191648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690594a-5b02-4cfc-bc37-0dca72d4a89d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:43.222400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:43.223156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:43.223444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:43.226077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.289288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:43.291861 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:43.292843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:43.293106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.295359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:43.301112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:43.342033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 930/1861] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:43 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:43.343424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:43.378066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed13d-09db-45d1-99f5-bc52d1a3b669 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:43.403068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:43.404729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:43.405102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:43.405627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:43.406074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:43.406630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.413711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:43.422860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 932/1862] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:43.423083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:43.452786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 931/1863] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:43.453599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:43.500433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c91d7-d086-4fd3-a2d0-f2f5fbc06472 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:43.525744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08177e-bb8c-4d17-9cd6-f869ae634798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:43.526647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08177e-bb8c-4d17-9cd6-f869ae634798 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:43.527069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08177e-bb8c-4d17-9cd6-f869ae634798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:43.527480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08177e-bb8c-4d17-9cd6-f869ae634798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.528240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08177e-bb8c-4d17-9cd6-f869ae634798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:43.533750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08177e-bb8c-4d17-9cd6-f869ae634798 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:43.577004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 933/1864] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:43.581468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:43.604143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:43.617618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c268ac-bd25-4313-ac43-18451c79a6e5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:43.624865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:43.626889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:43.628232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:43.628967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] PATH_INFO: `/v3/projects/9408151537f541c0867a79ce63304d85/users/1eb728cdc8434369a08e1dfdae9cac14/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.660393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9408151537f541c0867a79ce63304d85, user_id=1eb728cdc8434369a08e1dfdae9cac14, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:43.673798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:43.736669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 932/1865] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:43 2022] PUT /identity/v3/projects/9408151537f541c0867a79ce63304d85/users/1eb728cdc8434369a08e1dfdae9cac14/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:43.754155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:43.754859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:43.755471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:43.898152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] MFA Rules not processed for user `1eb728cdc8434369a08e1dfdae9cac14`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:43.903937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:44.253190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:44.254379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 934/1866] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:44.439061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1ca8-c78a-441d-997c-0e73df52f441 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:44.449935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:44.451830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:44.452775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:44.453750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:44.457056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:44.461713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:44.573160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 933/1867] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:44 2022] POST /identity/v3/projects => generated 367 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:44.575631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:44.614506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955c275-ca01-4b2b-84ef-4a1cfef224f8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:44.929236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:44.930164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:44.930453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:44.930726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:44.931611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:44.936069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:44.991439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:45.006376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 935/1868] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:44 2022] POST /identity/v3/users => generated 290 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:45.009568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20291b-8950-4a7e-a3fc-3c45f5e1b27f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:45.025704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:45.027958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:45.028346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:45.028536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:45.031863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:45.035464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:45.090174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:45.097671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 934/1869] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:45.098398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:45.107629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3154c-323b-482a-882a-bf75a14a816b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:45.129346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:45.130937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:45.135621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:45.136052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] PATH_INFO: `/v3/projects/e767980babd64ed580708c0a87e6ca10/users/1db73ec08acd405fb3b531b5153ffb60/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:45.172146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e767980babd64ed580708c0a87e6ca10, user_id=1db73ec08acd405fb3b531b5153ffb60, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:45.178911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:45.214140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 936/1870] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:45 2022] PUT /identity/v3/projects/e767980babd64ed580708c0a87e6ca10/users/1db73ec08acd405fb3b531b5153ffb60/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:45.215481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:45.231908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bd19-5b15-4b04-b730-6446ec38970c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:45.367058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2662fa-877d-42e7-9466-5ce98e375ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:45.367662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2662fa-877d-42e7-9466-5ce98e375ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:45.367662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2662fa-877d-42e7-9466-5ce98e375ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:45.368121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2662fa-877d-42e7-9466-5ce98e375ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:45.368785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2662fa-877d-42e7-9466-5ce98e375ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:45.370924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2662fa-877d-42e7-9466-5ce98e375ee2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:45.388698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 935/1871] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:45.390649 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:45.406669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4176a5-8c77-4846-aee9-40ce06d393cb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:45.419940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:45.423898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:45.424438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:45.425858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] PATH_INFO: `/v3/projects/e767980babd64ed580708c0a87e6ca10/users/1db73ec08acd405fb3b531b5153ffb60/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:45.430309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e767980babd64ed580708c0a87e6ca10, user_id=1db73ec08acd405fb3b531b5153ffb60, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:45.437316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:45.478804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 937/1872] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:45 2022] PUT /identity/v3/projects/e767980babd64ed580708c0a87e6ca10/users/1db73ec08acd405fb3b531b5153ffb60/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:45.486121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:45.486712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:45.487135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:45.583292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] MFA Rules not processed for user `1db73ec08acd405fb3b531b5153ffb60`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:45.598209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:45.777267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:45.895082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 936/1873] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:45.992534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:45.995508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:46.093574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e49fe-dd86-4d5e-b7d2-18179ac65682 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:46.106339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:46.108130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:46.112942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:46.113668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:46.149894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:46.154207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:46.178140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 938/1874] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:46.272534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:46.274970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:46.285462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:46.300430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17d59d-a39c-48b1-b025-978743880353 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:46.319318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786ae9e-5fd9-4253-a0f6-87104c7ce51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:46.320913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ae9e-5fd9-4253-a0f6-87104c7ce51d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:46.321483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ae9e-5fd9-4253-a0f6-87104c7ce51d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:46.322318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786ae9e-5fd9-4253-a0f6-87104c7ce51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:46.472293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786ae9e-5fd9-4253-a0f6-87104c7ce51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:46.474763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786ae9e-5fd9-4253-a0f6-87104c7ce51d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:46.491535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddcb00-1a9d-4b5b-a29b-89c1e263eb63 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:46.503344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 939/1875] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:46.521505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:46.522900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:46.524513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:46.526863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] PATH_INFO: `/v3/projects/34300e1c3e0140518efe861f9d713b55` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:46.532790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=34300e1c3e0140518efe861f9d713b55)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:46.540740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:46.664757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34300e1c3e0140518efe861f9d713b55', 'request_id': 'req-a4b60551-d3df-49f3-9f55-4bafbd575f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:46.681808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34300e1c3e0140518efe861f9d713b55', 'request_id': 'req-a4b60551-d3df-49f3-9f55-4bafbd575f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:46.709082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34300e1c3e0140518efe861f9d713b55', 'request_id': 'req-a4b60551-d3df-49f3-9f55-4bafbd575f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:46.766581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] The token cache is being invalidate because project 34300e1c3e0140518efe861f9d713b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:46.766759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:46.770401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a4b60551-d3df-49f3-9f55-4bafbd575f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:46.776326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 937/1876] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:46 2022] DELETE /identity/v3/projects/34300e1c3e0140518efe861f9d713b55 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:46.784993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:46.786429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:46.786992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:46.844329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:46.846427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:47.007532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 940/1877] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:47.022046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.022811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.023172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.083169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:47.091752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:47.122728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 938/1878] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:47.125652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.153089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36fcd-be15-4a2c-b605-3d8757a6bcb9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.167586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.168797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.169278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.169850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.171431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:47.172372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.178518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4bbd3-a72c-4efb-9f20-4143aaf88794 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.183987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:47.227357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 941/1879] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:47.230638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.273304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e1286-a6f1-4cd1-804c-b970d74d0c37 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.284409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3c01-3cbd-4665-84a3-0972d2153913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.285246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3c01-3cbd-4665-84a3-0972d2153913 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.287165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3c01-3cbd-4665-84a3-0972d2153913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.288225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3c01-3cbd-4665-84a3-0972d2153913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.290594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3c01-3cbd-4665-84a3-0972d2153913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.295109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3c01-3cbd-4665-84a3-0972d2153913 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.338731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa7234-eb38-4400-882a-0997f128632b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.339133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa7234-eb38-4400-882a-0997f128632b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.339666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa7234-eb38-4400-882a-0997f128632b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.343008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 942/1880] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:24:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:24:47.359146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 939/1881] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:47 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:47.360288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa7234-eb38-4400-882a-0997f128632b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.367651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.368408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.369297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.424073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:47.427238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:47.542750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:47.619772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa7234-eb38-4400-882a-0997f128632b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.633610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.634609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.634900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.635179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.635927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.638023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.683155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 943/1882] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:47 2022] POST /identity/v3/users => generated 291 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:47.687491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.701596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 940/1883] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:24:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:47.707451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc051b0a-97d1-441a-aaf7-05130aa1792d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.713157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.714070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.714306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.714585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.715479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.717477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.728904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.730601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:47.753263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 944/1884] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:47.759566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.763412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d37723-75a8-4360-ae4b-983fb773f15c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.783637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.784943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.785425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.785886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.806490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a2f77-26d2-46b3-83ba-0f33b63577db admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.812323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.814013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.814869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.815227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.815392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.815647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.816476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.819312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.841156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 945/1885] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:24:47.843185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.868786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e2bd-4bc5-446e-8d36-aba3fc5a68f9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:47.878332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 941/1886] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:47.879762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8768-7438-468c-8f54-5c3f406a2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:47.881792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8768-7438-468c-8f54-5c3f406a2ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.882703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8768-7438-468c-8f54-5c3f406a2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.883361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8768-7438-468c-8f54-5c3f406a2ddf admin admin] PATH_INFO: `/v3/projects/eb79412869104caca9a19cf9d551c37c/users/ff10a5b83de8403aaa6add282f7d0292/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:47.931478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e8768-7438-468c-8f54-5c3f406a2ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb79412869104caca9a19cf9d551c37c, user_id=ff10a5b83de8403aaa6add282f7d0292, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:47.935625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e8768-7438-468c-8f54-5c3f406a2ddf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:47.962363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:47.963833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 946/1887] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:47 2022] PUT /identity/v3/projects/eb79412869104caca9a19cf9d551c37c/users/ff10a5b83de8403aaa6add282f7d0292/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:47.964310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:47.981481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:47.981874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:47.982453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.012889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a1203-f12f-49dc-852d-53836b2679e3 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.063958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] MFA Rules not processed for user `ff10a5b83de8403aaa6add282f7d0292`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:48.077910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:48.166080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.168608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.169155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.169838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] PATH_INFO: `/v3/users/44eeef3290944185a90499cb651748a0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.174229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=44eeef3290944185a90499cb651748a0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.180449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.182922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 947/1888] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:48.189743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.210758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f68c-d656-42bf-9372-3f438a1afaaf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.218784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.220282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.220921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.221399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.222161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.224217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.274210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 948/1889] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:48 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:48.280862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.313256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:48.338775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44eeef3290944185a90499cb651748a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:48.372823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44eeef3290944185a90499cb651748a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:48.394770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44eeef3290944185a90499cb651748a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:48.394770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44eeef3290944185a90499cb651748a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:48.402540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cb64636f-c675-48a2-ba4f-401ca06d07bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44eeef3290944185a90499cb651748a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:48.410986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 942/1890] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:47 2022] DELETE /identity/v3/users/44eeef3290944185a90499cb651748a0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:48.416688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.417136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.417422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.437139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:48.438632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:48.455430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb3aed-fce0-4b51-9b87-0c96a19a2585 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.477099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:48.567839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.569052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.569185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.569476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.570333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.573626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.578164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 943/1891] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:48.593121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.595161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:48.617067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 949/1892] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:48 2022] POST /identity/v3/users => generated 297 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:48.618810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.621206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:48.637419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734098-af84-42a5-aadd-4bd4ee8c71e6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.644025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.644729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.644975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.645249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.646008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.647659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.664953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 950/1893] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:48.666050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.678367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db4342-7fd0-40c5-9bca-ee627b1dfd26 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.686423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.689726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.690343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.690770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] PATH_INFO: `/v3/projects/adfc689c995848a19ef1561ec8aff831/users/9fa6a350fb1f4ef5a2b3f2c19d01d1a5/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.713930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfc689c995848a19ef1561ec8aff831, user_id=9fa6a350fb1f4ef5a2b3f2c19d01d1a5, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.717729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.732624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8f4b3-0140-4a20-a35f-5940ba58e9bd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.744658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 951/1894] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:48 2022] PUT /identity/v3/projects/adfc689c995848a19ef1561ec8aff831/users/9fa6a350fb1f4ef5a2b3f2c19d01d1a5/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:48.745955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.836208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47d411-f72a-495a-8625-f08cb7edbfb6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.847823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.848563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.849139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.849419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.850562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.852757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.853853 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0408ac-7f62-441c-8234-8654baf6dd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.854768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0408ac-7f62-441c-8234-8654baf6dd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.855247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0408ac-7f62-441c-8234-8654baf6dd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.855760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0408ac-7f62-441c-8234-8654baf6dd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.867352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 952/1895] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:48.868564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0408ac-7f62-441c-8234-8654baf6dd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.870261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0408ac-7f62-441c-8234-8654baf6dd60 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.872682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:48.880458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:48.885462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 944/1896] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:48.885802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3c89-d65f-423e-896e-b9b1de6b97d8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:48.893365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:48.894834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.895220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.895597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] PATH_INFO: `/v3/projects/adfc689c995848a19ef1561ec8aff831/users/9fa6a350fb1f4ef5a2b3f2c19d01d1a5/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:48.898282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfc689c995848a19ef1561ec8aff831, user_id=9fa6a350fb1f4ef5a2b3f2c19d01d1a5, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:48.901256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:48.918593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 953/1897] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:48 2022] PUT /identity/v3/projects/adfc689c995848a19ef1561ec8aff831/users/9fa6a350fb1f4ef5a2b3f2c19d01d1a5/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:48.927476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:48.927912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:48.928255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:49.005316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] MFA Rules not processed for user `9fa6a350fb1f4ef5a2b3f2c19d01d1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:49.010810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:49.153091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 945/1898] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:49.170330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:49.173642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:49.275582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369a726-0c0f-4b28-bf1b-72b3e453713a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:49.285209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:49.286295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:49.288081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:49.288701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:49.308332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:49.311730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:49.339476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 954/1899] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:49.523568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:49.531318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:49.533671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:49.535223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5848ca-c04e-42ce-a0c7-c28c4c601dbd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:49.539701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:49.540377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:49.540655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:49.540932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:49.543672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:49.569767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:49.663935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:49.666471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:49.674103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace90b7-d1de-40c4-9825-9099b9e2222f service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:49.679283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:49.680431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:49.680923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:49.681257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] PATH_INFO: `/v3/projects/99624fbcaabf4278a48c92ea56021c89` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:49.682940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99624fbcaabf4278a48c92ea56021c89)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:49.683552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 946/1900] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:49.684985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:49.762905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99624fbcaabf4278a48c92ea56021c89', 'request_id': 'req-edb537cc-d5cc-4fa9-970c-1f4b6f878528'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:49.774638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99624fbcaabf4278a48c92ea56021c89', 'request_id': 'req-edb537cc-d5cc-4fa9-970c-1f4b6f878528'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:49.785227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99624fbcaabf4278a48c92ea56021c89', 'request_id': 'req-edb537cc-d5cc-4fa9-970c-1f4b6f878528'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:49.808746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] The token cache is being invalidate because project 99624fbcaabf4278a48c92ea56021c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:49.808746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:49.810483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:49.816316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 955/1901] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:49 2022] DELETE /identity/v3/projects/99624fbcaabf4278a48c92ea56021c89 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:49.822564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:49.858083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab535-e582-4d12-94c8-d204d209cf8e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:50.058457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:50.059645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:50.060144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:50.060634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] PATH_INFO: `/v3/users/b2a40ce3991a44829fb29187b460c8d5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:50.065215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a40ce3991a44829fb29187b460c8d5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:50.069595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:50.162598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a40ce3991a44829fb29187b460c8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:50.176813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a40ce3991a44829fb29187b460c8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:50.187050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a40ce3991a44829fb29187b460c8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:50.188613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a40ce3991a44829fb29187b460c8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:50.199682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a40ce3991a44829fb29187b460c8d5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:50.207949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 947/1902] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:49 2022] DELETE /identity/v3/users/b2a40ce3991a44829fb29187b460c8d5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:50.841406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:50.842974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:50.863510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb537cc-d5cc-4fa9-970c-1f4b6f878528 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:50.892971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:51.003679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:51.005340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.005786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.006609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] PATH_INFO: `/v3/users/ff386fbce7414511ae5f79f0e300a00e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.013674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff386fbce7414511ae5f79f0e300a00e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:51.016045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:51.026022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:51.027585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:51.048128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc62dc9-c59c-4588-8477-e8b517308d22 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:51.069926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:51.077940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.077940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.077940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] PATH_INFO: `/v3/projects/002becc5f264479f88d3c8d987496124` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.082868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=002becc5f264479f88d3c8d987496124)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:51.087519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:51.155028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:51.177281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff386fbce7414511ae5f79f0e300a00e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.178780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff386fbce7414511ae5f79f0e300a00e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.195860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff386fbce7414511ae5f79f0e300a00e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.196166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002becc5f264479f88d3c8d987496124', 'request_id': 'req-e5b368b6-3406-4b87-8d73-ea247b5681f5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.214717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff386fbce7414511ae5f79f0e300a00e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.217916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002becc5f264479f88d3c8d987496124', 'request_id': 'req-e5b368b6-3406-4b87-8d73-ea247b5681f5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.236185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002becc5f264479f88d3c8d987496124', 'request_id': 'req-e5b368b6-3406-4b87-8d73-ea247b5681f5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.264340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4024c8bd-1f52-4138-971d-d9e5b8c87010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff386fbce7414511ae5f79f0e300a00e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.289496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] The token cache is being invalidate because project 002becc5f264479f88d3c8d987496124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:51.290058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.298433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 956/1903] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:50 2022] DELETE /identity/v3/users/ff386fbce7414511ae5f79f0e300a00e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:51.298698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e5b368b6-3406-4b87-8d73-ea247b5681f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:51.299826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 948/1904] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:51 2022] DELETE /identity/v3/projects/002becc5f264479f88d3c8d987496124 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:51.302866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.303732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.304431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.306604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3a60-9e9c-4f5c-8c7b-f35302f72c93 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.307003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3a60-9e9c-4f5c-8c7b-f35302f72c93 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.307423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3a60-9e9c-4f5c-8c7b-f35302f72c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.332533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-764f3a60-9e9c-4f5c-8c7b-f35302f72c93 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:51.334005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-764f3a60-9e9c-4f5c-8c7b-f35302f72c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:51.354503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:51.354503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:51.454328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 949/1905] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:51.465247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.466219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.467471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.484034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 957/1906] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:51.498019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:51.499886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:51.510676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:51.512681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:51.533132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 950/1907] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:51.539517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:51.551552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218e4ee-0a8d-4fcd-af7e-8cee8c1e1305 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:51.557781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:51.558606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.558962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.559467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.560318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:51.560739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:51.562652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:51.594741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 951/1908] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:51.596271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:51.620444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:51.624374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa10d-ffd6-464e-b9a9-237407727ffb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:51.642394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:51.643173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.643729 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.645103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.645987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:51.648748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:51.650965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20f059-247d-4f56-bbf4-702b4fb13ca1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:51.670057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:51.674101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.674101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.674101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.709873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:51.711595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:51.735465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 958/1909] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:51.739289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 952/1910] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:51 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:51.741088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:51.752699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bafb4b-d92b-483d-87a2-5067d8fbd6a0 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:51.835817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:51.838051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:51.982387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:51.986361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:51.987333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:51.989248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:51.991182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:51.996150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:51.996764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d8aa-4596-4b4b-b661-9c07318b35d1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:52.017993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:52.019039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.020022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.020412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] PATH_INFO: `/v3/users/1eb728cdc8434369a08e1dfdae9cac14` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.024592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb728cdc8434369a08e1dfdae9cac14)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:52.027170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:52.057361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 959/1911] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:51 2022] POST /identity/v3/users => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:24:52.063477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:52.076698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9f31-7a6f-4bab-8a02-fd538eb4f883 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:52.092194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:52.096245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.098350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.098756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.099614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:52.101360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:52.104053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:52.115656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 960/1912] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:52.124690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:52.143030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848a5a-5130-477d-a4ff-1eb3b37d3b1b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:52.149469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:52.150197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.150539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.150828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.152261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:52.153945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:52.162493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb728cdc8434369a08e1dfdae9cac14'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:52.167945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 961/1913] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:52.176723 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:52.193653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb728cdc8434369a08e1dfdae9cac14'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:52.203044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb728cdc8434369a08e1dfdae9cac14'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:52.203311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3cdf7-1f36-4008-8c3e-9471ba2a741f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:52.203867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb728cdc8434369a08e1dfdae9cac14'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:52.213154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f9f36d9a-1975-47e3-a750-eff949fecafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb728cdc8434369a08e1dfdae9cac14'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:52.220730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 953/1914] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:51 2022] DELETE /identity/v3/users/1eb728cdc8434369a08e1dfdae9cac14 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:52.220953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86ae7-4337-4114-a821-2f4820b1aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:52.222355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86ae7-4337-4114-a821-2f4820b1aa6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.222810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86ae7-4337-4114-a821-2f4820b1aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.225343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.225644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.225933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.227273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86ae7-4337-4114-a821-2f4820b1aa6a admin admin] PATH_INFO: `/v3/projects/a001b7781508430cb8ce935845e64e29/users/8cd311c4005444ca8a6eb30a56ca9b26/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.262823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e86ae7-4337-4114-a821-2f4820b1aa6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a001b7781508430cb8ce935845e64e29, user_id=8cd311c4005444ca8a6eb30a56ca9b26, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:52.264093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:52.272253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:52.280482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e86ae7-4337-4114-a821-2f4820b1aa6a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:52.370623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 962/1915] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:52 2022] PUT /identity/v3/projects/a001b7781508430cb8ce935845e64e29/users/8cd311c4005444ca8a6eb30a56ca9b26/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:52.389063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.389564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.390114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.521130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] MFA Rules not processed for user `8cd311c4005444ca8a6eb30a56ca9b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:52.523562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:52.552236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 954/1916] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:52.568106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:52.571423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:52.724444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 963/1917] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:52.725520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:52.728009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:52.775376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7887bdf-175a-41d0-b551-43edfce00516 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:52.785107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:52.895118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:52.896991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.897896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.899084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.900708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef8797-5d83-4651-b650-f861d67fe95a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:52.906270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:52.907757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:52.908042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:52.908323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] PATH_INFO: `/v3/projects/955f5a89aca3474f9048874e5fa24d9f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:52.909886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955f5a89aca3474f9048874e5fa24d9f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:52.912075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:52.920772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:52.929204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:52.934098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:52.965645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 955/1918] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:52.968513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:52.975992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:52.996295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955f5a89aca3474f9048874e5fa24d9f', 'request_id': 'req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:53.008603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08dfd8-5422-406d-af08-60e9e1f8c245 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.010898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955f5a89aca3474f9048874e5fa24d9f', 'request_id': 'req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:53.027662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955f5a89aca3474f9048874e5fa24d9f', 'request_id': 'req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:53.052759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] The token cache is being invalidate because project 955f5a89aca3474f9048874e5fa24d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:53.054496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:53.056641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cbe7706c-6ddd-4bce-9175-f6cd2c315e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:53.061253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 964/1919] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:52 2022] DELETE /identity/v3/projects/955f5a89aca3474f9048874e5fa24d9f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:53.086350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.086874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.087374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.108157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2a08f-175f-4628-97b5-b080ef42a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.114845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2a08f-175f-4628-97b5-b080ef42a751 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.114845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2a08f-175f-4628-97b5-b080ef42a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.114845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2a08f-175f-4628-97b5-b080ef42a751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.114845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2a08f-175f-4628-97b5-b080ef42a751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.114845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2a08f-175f-4628-97b5-b080ef42a751 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.139040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:53.141223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:53.155372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 965/1920] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:53.161560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.163790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:53.164267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 956/1921] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:52 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:53.167793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.168621 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.169100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.181936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714d47-b43f-437a-9ec2-87ed4454a98c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.220229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:53.221490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:53.373624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.376808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.376972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.377171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.378056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.384974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.392394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 957/1922] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:53.412230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.432277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 966/1923] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:53 2022] POST /identity/v3/users => generated 307 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:53.436680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.437104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd5336-e7e6-469d-8be0-f487bf646fd3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.448834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.450176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.450848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.451326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.452473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:53.452990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.456932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.484199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cfb73-8d0e-40e7-a40a-581058f89250 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.496076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.497077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.497667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.498121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.499012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.506205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.506735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 958/1924] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:24:53.512509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.536482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 967/1925] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:53.538525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705881-58e1-4e23-9cd1-efb8bb4a683d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.538772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.546850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.549939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.551515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.551987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.554866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.559912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.566292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aa8eb-b58b-4b18-9cf7-effff4f11de9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.597069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.600567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.600901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.601189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] PATH_INFO: `/v3/projects/381a4d044b1a41ca89ca2a75d6550800/users/2c7752771a2f4f5d90bbe8d10c42f1c1/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.635644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=381a4d044b1a41ca89ca2a75d6550800, user_id=2c7752771a2f4f5d90bbe8d10c42f1c1, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.649731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.670154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:53.677286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 959/1926] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:53 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:24:53.678749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.689283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 968/1927] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:53 2022] PUT /identity/v3/projects/381a4d044b1a41ca89ca2a75d6550800/users/2c7752771a2f4f5d90bbe8d10c42f1c1/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:53.695091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:53.698183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:53.854606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:53.869196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb7ba-713d-45b0-b73f-96341b835cdf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.906307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d428f5-b65a-4c2b-8917-97a79457e119 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:53.923098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.925903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.926445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.927020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] PATH_INFO: `/v3/projects/9408151537f541c0867a79ce63304d85` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.929449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9408151537f541c0867a79ce63304d85)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.933352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:53.954237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:53.955306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:53.955483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:53.955744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:53.956589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:53.959083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.007001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 969/1928] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:53 2022] POST /identity/v3/users => generated 286 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:54.007001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.024924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91be36-d805-47ed-bdd1-3357161ac57b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.042987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9408151537f541c0867a79ce63304d85', 'request_id': 'req-4e781242-49e7-4e4b-a06e-deabadc9837f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.053494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9408151537f541c0867a79ce63304d85', 'request_id': 'req-4e781242-49e7-4e4b-a06e-deabadc9837f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.062208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9408151537f541c0867a79ce63304d85', 'request_id': 'req-4e781242-49e7-4e4b-a06e-deabadc9837f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.086460 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] The token cache is being invalidate because project 9408151537f541c0867a79ce63304d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:54.087364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.088805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.092431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 960/1929] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:53 2022] DELETE /identity/v3/projects/9408151537f541c0867a79ce63304d85 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:54.097787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.097787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.142388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.143391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.143706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.143937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.144851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.146568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.164600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 970/1930] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:54.164600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.166846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.183265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36009a6-b2da-4570-af4d-764fc7ac319b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.188862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.189846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.190179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.190444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] PATH_INFO: `/v3/users/1db73ec08acd405fb3b531b5153ffb60` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.191932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db73ec08acd405fb3b531b5153ffb60)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.193943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.206850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e781242-49e7-4e4b-a06e-deabadc9837f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.215936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.217106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.217598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.218112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.220017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.223188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.232918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:54.240093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 961/1931] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:54.242082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.245326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.260452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a789fb-c7b1-4c30-ad1d-95077d6447ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.265599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.266566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.266846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.267124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] PATH_INFO: `/v3/projects/381a4d044b1a41ca89ca2a75d6550800/users/2c7752771a2f4f5d90bbe8d10c42f1c1/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.267425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db73ec08acd405fb3b531b5153ffb60'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.268332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db73ec08acd405fb3b531b5153ffb60'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.269349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381a4d044b1a41ca89ca2a75d6550800, user_id=2c7752771a2f4f5d90bbe8d10c42f1c1, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.272083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.277396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db73ec08acd405fb3b531b5153ffb60'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.286158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 962/1932] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:54 2022] PUT /identity/v3/projects/381a4d044b1a41ca89ca2a75d6550800/users/2c7752771a2f4f5d90bbe8d10c42f1c1/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:54.287031 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.288746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.294276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db73ec08acd405fb3b531b5153ffb60'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.316312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6e4def6a-69b2-4c56-852f-8dde0b184075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db73ec08acd405fb3b531b5153ffb60'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.325402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 971/1933] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:24:54 2022] DELETE /identity/v3/users/1db73ec08acd405fb3b531b5153ffb60 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:54.327241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.327650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.328122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.368968 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] MFA Rules not processed for user `2c7752771a2f4f5d90bbe8d10c42f1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:54.370377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.387868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e110c-0316-427d-864a-f77805aba858 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.393770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:54.470430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 972/1934] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:54.485941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.488890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.491300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.492331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.492953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.493433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.494639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.496588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.511669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 963/1935] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:54.517191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.532479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e964699-db7a-4d1a-a4f7-41e15d1d9581 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.538407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342516-0559-4e6c-b327-86557708d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.539472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342516-0559-4e6c-b327-86557708d88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.539767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342516-0559-4e6c-b327-86557708d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.540112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342516-0559-4e6c-b327-86557708d88d admin admin] PATH_INFO: `/v3/projects/640eb7d258574c69b824d2d9858d5ba8/users/71d99aa30493428897ca7c8c2909a4f8/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.560750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342516-0559-4e6c-b327-86557708d88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=640eb7d258574c69b824d2d9858d5ba8, user_id=71d99aa30493428897ca7c8c2909a4f8, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.564438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342516-0559-4e6c-b327-86557708d88d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.588703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 964/1936] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:54 2022] PUT /identity/v3/projects/640eb7d258574c69b824d2d9858d5ba8/users/71d99aa30493428897ca7c8c2909a4f8/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:54.598019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.599390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.599390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.620203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e4e5-e88e-4db7-84cb-7f7ab406bc3a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.632569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:54.634951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.708631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:54.726907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.727960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.729320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.730045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.746015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 965/1937] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:24:54.752224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.754189 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.784012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b702e1-dd34-4d07-ba85-b6bc57588b3c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:54.794626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:54.796385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:54.796885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:54.797930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] PATH_INFO: `/v3/projects/e767980babd64ed580708c0a87e6ca10` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:54.800196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e767980babd64ed580708c0a87e6ca10)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.805436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.868085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:54.872563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:54.894289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 973/1938] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:54.894289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:54.894289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:54.914526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e767980babd64ed580708c0a87e6ca10', 'request_id': 'req-7a0af0a5-b636-4936-9ba6-d3252174bf98'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.932276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e767980babd64ed580708c0a87e6ca10', 'request_id': 'req-7a0af0a5-b636-4936-9ba6-d3252174bf98'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:54.969719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e767980babd64ed580708c0a87e6ca10', 'request_id': 'req-7a0af0a5-b636-4936-9ba6-d3252174bf98'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:55.027780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] The token cache is being invalidate because project e767980babd64ed580708c0a87e6ca10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:24:55.028476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:55.030487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:24:55.039193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 966/1939] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:54 2022] DELETE /identity/v3/projects/e767980babd64ed580708c0a87e6ca10 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:55.041308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:55.044490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b51d-ef77-4fe5-8477-2136a9f09c5d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:55.044973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:55.069407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:55.230278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:55.232399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:55.233350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:55.234178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:55.238884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:55.271868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0af0a5-b636-4936-9ba6-d3252174bf98 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:55.290311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:55.291759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:55.292056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:55.295493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:55.303201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:55.433266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:55.435531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758c63-3897-42c2-967d-052a4eadfbfe service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:55.445391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:55.457463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 974/1940] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:55.459986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:55.460459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:55.460917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:55.463845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:55.467213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a405c-c362-4732-bff0-c2493968b955 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:55.488530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 967/1941] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:55.492545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:55.495397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:55.512538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 975/1942] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:55.525457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:55.526249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:55.527151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:55.566540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:55.570597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:55.595358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 968/1943] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:55.602002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:55.623294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cc89f-254b-48a9-bff5-39fbedbf1bd4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:55.646634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:55.647775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:55.648214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:55.648616 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:55.650222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:55.650982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:55.656037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:55.717348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 976/1944] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:55.724586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:55.752029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864dc7-7328-477b-88bf-b090bd3a7e81 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:55.791475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:55.796142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:55.797462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:55.798809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:55.801984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:55.808141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:55.864933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 969/1945] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:55 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:24:55.865200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:55.882025 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec74eb4-b963-42e5-b3b2-3c8a4ffeaccf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:56.052899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:56.054045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:56.054045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:56.054045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:56.054522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:56.057327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:56.108852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 977/1946] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:55 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:24:56.110421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:56.128029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcff59-221b-4be8-9a9b-fad6f9683748 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:56.166281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:56.167441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:56.167933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:56.171383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:56.172985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:56.180241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:56.246270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 970/1947] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:56.248275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:56.275265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bef42-47de-4da8-b0b5-ae3fac553a67 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:56.297231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3d36e-38f3-4ff4-b543-cfd676f95fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:56.298440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3d36e-38f3-4ff4-b543-cfd676f95fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:56.299380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3d36e-38f3-4ff4-b543-cfd676f95fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:56.300457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3d36e-38f3-4ff4-b543-cfd676f95fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:56.301233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3d36e-38f3-4ff4-b543-cfd676f95fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:56.304377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3d36e-38f3-4ff4-b543-cfd676f95fd3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:56.361003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 978/1948] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:56.367396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:56.411372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe02913-4f18-437f-8713-c2fb46e123a1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:56.443938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:56.446451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:56.446991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:56.447478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] PATH_INFO: `/v3/projects/19beaa3b142546338c19d670b6aa51b8/users/d16d2946fb4445968cee6abb23b885cb/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:56.475133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19beaa3b142546338c19d670b6aa51b8, user_id=d16d2946fb4445968cee6abb23b885cb, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:56.479951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:56.522725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 971/1949] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:56 2022] PUT /identity/v3/projects/19beaa3b142546338c19d670b6aa51b8/users/d16d2946fb4445968cee6abb23b885cb/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:56.531338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:56.531965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:56.532525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:56.576165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] MFA Rules not processed for user `d16d2946fb4445968cee6abb23b885cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:56.578059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:56.754375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 979/1950] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:56.754545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:56.949693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:56.976038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba4eca-46b4-4eb6-9c21-36f67cafd1d4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:56.984039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a32e6d-7151-41ed-a2bc-5f713cc7582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:56.985483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32e6d-7151-41ed-a2bc-5f713cc7582d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:56.985832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32e6d-7151-41ed-a2bc-5f713cc7582d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:56.986207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32e6d-7151-41ed-a2bc-5f713cc7582d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:56.987159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a32e6d-7151-41ed-a2bc-5f713cc7582d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:56.990239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a32e6d-7151-41ed-a2bc-5f713cc7582d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.056423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 972/1951] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:56 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:57.060796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:57.086150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44318243-7398-4b47-80d8-e2b47388b485 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:57.157228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.158661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.160403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.234287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:57.248709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] MFA Rules not processed for user `71d99aa30493428897ca7c8c2909a4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:57.251842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:57.276246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:57.280186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.284027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.284804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.290168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:57.299580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.360680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 980/1952] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:24:57 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:57.375792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:57.387404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f9fa4-d157-457b-bcf5-419345d5f311 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:57.403454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:57.416426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.421755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.422423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.423931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:57.434547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.478024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 981/1953] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:24:57.480509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:57.487676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 973/1954] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:57.511622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a6f0a-1664-4b7b-9269-ecfa531c47a9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:57.529956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:57.530379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:57.534234 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.535837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.536140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] PATH_INFO: `/v3/projects/277263855d87420da4ab6e365e3cd9ff/users/bff50c6c546947fc899f695b77945d23/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.560047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277263855d87420da4ab6e365e3cd9ff, user_id=bff50c6c546947fc899f695b77945d23, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:57.564675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.593807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 982/1955] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:57 2022] PUT /identity/v3/projects/277263855d87420da4ab6e365e3cd9ff/users/bff50c6c546947fc899f695b77945d23/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:24:57.600561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:57.664424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087ed26-c08d-40a1-a399-bca55d541496 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:57.705458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82b06-4d6a-4e9e-80af-343213d91871 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:57.716500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:57.718605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.720753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.721270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.724154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:57.729156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.743790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:57.744484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.744767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.745049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.754433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 983/1956] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:24:57.758535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:57.776549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bc62e-6aa5-460e-835c-363c4052f893 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:57.795095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6c07-dfca-48e5-96b7-4fddaac3639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:57.798139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6c07-dfca-48e5-96b7-4fddaac3639a admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.798139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6c07-dfca-48e5-96b7-4fddaac3639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.798589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6c07-dfca-48e5-96b7-4fddaac3639a admin admin] PATH_INFO: `/v3/projects/277263855d87420da4ab6e365e3cd9ff/users/bff50c6c546947fc899f695b77945d23/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.799774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:57.802891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6c07-dfca-48e5-96b7-4fddaac3639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=277263855d87420da4ab6e365e3cd9ff, user_id=bff50c6c546947fc899f695b77945d23, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:57.809425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6c07-dfca-48e5-96b7-4fddaac3639a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.837377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 984/1957] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:24:57 2022] PUT /identity/v3/projects/277263855d87420da4ab6e365e3cd9ff/users/bff50c6c546947fc899f695b77945d23/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:24:57.839117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:57.839508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:57.839881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:57.855786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:57.860849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:57.908495 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 974/1958] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:24:57.911589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] MFA Rules not processed for user `bff50c6c546947fc899f695b77945d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:57.913667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:58.210516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 985/1959] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:24:58.442860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:58.451644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:24:58.474446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e328c4-07cc-4b90-a163-02c187816015 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:58.557260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:58.558092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:58.558449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:58.558800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:58.571567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:58.573166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:58.598979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 975/1960] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:24:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:24:59.284120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:59.299299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da65d15-d2d9-4d99-a50b-b3bef1bfde30 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:59.324683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff50c6c546947fc899f695b77945d23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277263855d87420da4ab6e365e3cd9ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:59.324839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:59.325124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:59.325514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:59.326482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:59.326860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:59.330764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:59.340292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:59.352139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 986/1961] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:59.353219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:59.380030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b6ed-dd95-449a-b9b9-94451b1736d3 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:59.405582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84da787-ae7e-41b1-bbf1-6e9449c50e06 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff50c6c546947fc899f695b77945d23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277263855d87420da4ab6e365e3cd9ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:59.407831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84da787-ae7e-41b1-bbf1-6e9449c50e06 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:59.407831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84da787-ae7e-41b1-bbf1-6e9449c50e06 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:59.407831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84da787-ae7e-41b1-bbf1-6e9449c50e06 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:59.409130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84da787-ae7e-41b1-bbf1-6e9449c50e06 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:59.418513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84da787-ae7e-41b1-bbf1-6e9449c50e06 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:59.538846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 976/1962] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:24:59 2022] POST /identity/v3/projects => generated 354 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:24:59.540652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:59.574453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96129d04-97d2-42b9-bc7e-f04ca696431b tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:59.749290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff50c6c546947fc899f695b77945d23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277263855d87420da4ab6e365e3cd9ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:24:59.751804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:59.752708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:59.753521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:59.758021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:24:59.759047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:24:59.782837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:24:59.858490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 987/1963] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:24:59.939698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:24:59.940281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:24:59.940281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:24:59.962989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:24:59.980010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243dfb-8b62-4701-b9db-075ddd78d31e tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:24:59.986389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] MFA Rules not processed for user `71d99aa30493428897ca7c8c2909a4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:24:59.987870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:00.014108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff50c6c546947fc899f695b77945d23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277263855d87420da4ab6e365e3cd9ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:00.019550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:00.021360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:00.021870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] PATH_INFO: `/v3/projects/3995114639f3401ebc54cbfbeb6260d1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:00.025878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3995114639f3401ebc54cbfbeb6260d1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:00.027927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:00.126421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 977/1964] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:24:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:00.155205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3995114639f3401ebc54cbfbeb6260d1', 'request_id': 'req-901e7b19-caef-40b6-bd93-3cadaef79f24'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:00.169801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3995114639f3401ebc54cbfbeb6260d1', 'request_id': 'req-901e7b19-caef-40b6-bd93-3cadaef79f24'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:00.200287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3995114639f3401ebc54cbfbeb6260d1', 'request_id': 'req-901e7b19-caef-40b6-bd93-3cadaef79f24'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:00.254109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] The token cache is being invalidate because project 3995114639f3401ebc54cbfbeb6260d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:00.256192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:00.261559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:00.263897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 988/1965] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:24:59 2022] DELETE /identity/v3/projects/3995114639f3401ebc54cbfbeb6260d1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:00.587048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:00.589758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:00.796757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4ef06-dc8b-43a0-a9f3-2d04428e4259 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:00.817052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:00.856213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:00.861124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:00.932147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:00.933109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:00.933392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:00.933667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] PATH_INFO: `/v3/users/ff10a5b83de8403aaa6add282f7d0292` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:00.935159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff10a5b83de8403aaa6add282f7d0292)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:00.937230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:01.058566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff10a5b83de8403aaa6add282f7d0292'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.063111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7b19-caef-40b6-bd93-3cadaef79f24 tempest-VolumeQuotaClassesTest-1002581098 tempest-VolumeQuotaClassesTest-1002581098-project-admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:01.076114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:01.080687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:01.082309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:01.083275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] PATH_INFO: `/v3/users/d16d2946fb4445968cee6abb23b885cb` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:01.086014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16d2946fb4445968cee6abb23b885cb)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:01.093308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:01.094205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff10a5b83de8403aaa6add282f7d0292'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.123748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff10a5b83de8403aaa6add282f7d0292'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.126163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff10a5b83de8403aaa6add282f7d0292'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.131514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:01.148098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff10a5b83de8403aaa6add282f7d0292'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.163028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 978/1966] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:00 2022] DELETE /identity/v3/users/ff10a5b83de8403aaa6add282f7d0292 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:01.169605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:01.173214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:01.221071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16d2946fb4445968cee6abb23b885cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.222334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16d2946fb4445968cee6abb23b885cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.241054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16d2946fb4445968cee6abb23b885cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.259683 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16d2946fb4445968cee6abb23b885cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.300468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bee193e0-3a5d-4b7d-80d3-42247b91ed9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16d2946fb4445968cee6abb23b885cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.325088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 989/1967] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:00 2022] DELETE /identity/v3/users/d16d2946fb4445968cee6abb23b885cb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:01.328179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d9d33-22f8-4c4a-9e79-bf4b118d2ab1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:01.328925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d9d33-22f8-4c4a-9e79-bf4b118d2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:01.329424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d9d33-22f8-4c4a-9e79-bf4b118d2ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:01.335921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda40b-808e-4f70-95a7-7d77290c1a08 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:01.372950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e89d9d33-22f8-4c4a-9e79-bf4b118d2ab1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:01.377465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e89d9d33-22f8-4c4a-9e79-bf4b118d2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:01.428223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:01.502323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:01.503809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:01.504327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:01.504841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] PATH_INFO: `/v3/users/8cd311c4005444ca8a6eb30a56ca9b26` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:01.520332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd311c4005444ca8a6eb30a56ca9b26)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:01.524784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:01.614091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 990/1968] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:01.614891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:01.614891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:01.615445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:01.708748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:01.711873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:01.729100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd311c4005444ca8a6eb30a56ca9b26'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.763570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd311c4005444ca8a6eb30a56ca9b26'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.765418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 991/1969] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:01.767062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:01.774232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:01.791689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd311c4005444ca8a6eb30a56ca9b26'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.793057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd311c4005444ca8a6eb30a56ca9b26'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.813829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd311c4005444ca8a6eb30a56ca9b26'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:01.829195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 979/1970] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:01 2022] DELETE /identity/v3/users/8cd311c4005444ca8a6eb30a56ca9b26 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:01.831300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:01.834229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:01.980198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7058-bcbd-4bcb-938e-ec6e6fefd06e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:01.981529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227060db-c05d-4af7-90f9-99f7cb7a6e92 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:01.987719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:01.989186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:01.989818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:01.990462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:01.992227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:01.993127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:01.993255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:01.993463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:01.994638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:02.005051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:02.112575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:02.158060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:02.160258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bcf4-ea7a-4e1e-9fbe-5ccb8a1eb203 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:02.190898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 992/1971] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:02.192840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:02.193318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:02.193799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:02.237609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:02.246238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:02.254407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:02.260358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:02.266440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 993/1972] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:02.287515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:02.304586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012706f-6653-4d73-bc88-b0b811e2a52e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:02.316199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:02.318958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:02.320064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 980/1973] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:02.321196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:02.321881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:02.349557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:02.351124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:02.371386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 994/1974] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:03.268952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:03.272469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:03.301900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:03.303822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:03.311320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc85fa-eae4-47be-ac67-70672d84b246 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:03.325744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b77911-aa5a-4509-b832-77459764a384 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:03.326943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:03.329616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:03.330890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:03.331981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] PATH_INFO: `/v3/projects/a001b7781508430cb8ce935845e64e29` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:03.335109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a001b7781508430cb8ce935845e64e29)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:03.339934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:03.341225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:03.342169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:03.342454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:03.342735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] PATH_INFO: `/v3/projects/19beaa3b142546338c19d670b6aa51b8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:03.347035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:03.350652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19beaa3b142546338c19d670b6aa51b8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:03.370177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:03.471774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a001b7781508430cb8ce935845e64e29', 'request_id': 'req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.490379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a001b7781508430cb8ce935845e64e29', 'request_id': 'req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.511207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a001b7781508430cb8ce935845e64e29', 'request_id': 'req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.535728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19beaa3b142546338c19d670b6aa51b8', 'request_id': 'req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.540751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] The token cache is being invalidate because project a001b7781508430cb8ce935845e64e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:03.541257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.543996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.551246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 981/1975] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:03 2022] DELETE /identity/v3/projects/a001b7781508430cb8ce935845e64e29 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:03.551720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19beaa3b142546338c19d670b6aa51b8', 'request_id': 'req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.553079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:03.555665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:03.577319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19beaa3b142546338c19d670b6aa51b8', 'request_id': 'req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.646134 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] The token cache is being invalidate because project 19beaa3b142546338c19d670b6aa51b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:03.648908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.650091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.660380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 995/1976] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:03 2022] DELETE /identity/v3/projects/19beaa3b142546338c19d670b6aa51b8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:03.662392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:03.663993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:03.753838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de30f0-27d8-4e2a-a9b3-e5ea6a9724d6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:03.834773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:03.835736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:03.836027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:03.836306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] PATH_INFO: `/v3/projects/eb79412869104caca9a19cf9d551c37c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:03.837643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb79412869104caca9a19cf9d551c37c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:03.839735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:03.917212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:03.931429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb79412869104caca9a19cf9d551c37c', 'request_id': 'req-2903f956-0e6e-4287-87e5-ec254d05741e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.939538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb79412869104caca9a19cf9d551c37c', 'request_id': 'req-2903f956-0e6e-4287-87e5-ec254d05741e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.947733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb79412869104caca9a19cf9d551c37c', 'request_id': 'req-2903f956-0e6e-4287-87e5-ec254d05741e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.975300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb4e2-d6f0-4485-8a7a-932acf90e5c2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:03.987936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] The token cache is being invalidate because project eb79412869104caca9a19cf9d551c37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:03.987936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.990492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:03.996703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 982/1977] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:03 2022] DELETE /identity/v3/projects/eb79412869104caca9a19cf9d551c37c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:03.998801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:04.000972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:04.080164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:04.101201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:04.102233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:04.103356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:04.103734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] PATH_INFO: `/v3/users/2c7752771a2f4f5d90bbe8d10c42f1c1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:04.105496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7752771a2f4f5d90bbe8d10c42f1c1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:04.107921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:04.156587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903f956-0e6e-4287-87e5-ec254d05741e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:04.166111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:04.167027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:04.167389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:04.167611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] PATH_INFO: `/v3/users/bff50c6c546947fc899f695b77945d23` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:04.168817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff50c6c546947fc899f695b77945d23)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:04.170876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:04.188718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7752771a2f4f5d90bbe8d10c42f1c1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.195459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7752771a2f4f5d90bbe8d10c42f1c1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.207707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7752771a2f4f5d90bbe8d10c42f1c1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.232148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7752771a2f4f5d90bbe8d10c42f1c1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.260271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff50c6c546947fc899f695b77945d23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.281806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff50c6c546947fc899f695b77945d23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.297582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff50c6c546947fc899f695b77945d23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.298605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff50c6c546947fc899f695b77945d23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.309150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff50c6c546947fc899f695b77945d23'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.323752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 983/1978] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:03 2022] DELETE /identity/v3/users/bff50c6c546947fc899f695b77945d23 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:04.323752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:04.323752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:04.335381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7752771a2f4f5d90bbe8d10c42f1c1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:04.381490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 996/1979] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:03 2022] DELETE /identity/v3/users/2c7752771a2f4f5d90bbe8d10c42f1c1 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:04.536157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:04.585856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca60bf-cddd-4696-8616-387aa92da632 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:04.978153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:04.983764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:04.986403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:04.988384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] PATH_INFO: `/v3/users/9fa6a350fb1f4ef5a2b3f2c19d01d1a5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:04.995660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa6a350fb1f4ef5a2b3f2c19d01d1a5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:05.022647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:05.239327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa6a350fb1f4ef5a2b3f2c19d01d1a5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:05.274482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa6a350fb1f4ef5a2b3f2c19d01d1a5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:05.294870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa6a350fb1f4ef5a2b3f2c19d01d1a5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:05.296025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa6a350fb1f4ef5a2b3f2c19d01d1a5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:05.315706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa6a350fb1f4ef5a2b3f2c19d01d1a5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:05.333908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 984/1980] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:04 2022] DELETE /identity/v3/users/9fa6a350fb1f4ef5a2b3f2c19d01d1a5 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:06.280342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:06.284254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:06.308529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b850f-4b8b-449f-9956-67a8e79062e8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:06.355909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:06.357471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:06.451336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:06.456052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:06.456920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:06.457722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] PATH_INFO: `/v3/projects/381a4d044b1a41ca89ca2a75d6550800` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:06.460867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=381a4d044b1a41ca89ca2a75d6550800)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:06.466346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:06.591630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14967fd-74f2-4024-a96d-59440531dd89 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:06.614953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381a4d044b1a41ca89ca2a75d6550800', 'request_id': 'req-ed1f71b0-9ffd-4753-a97c-389687c109bd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.624591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381a4d044b1a41ca89ca2a75d6550800', 'request_id': 'req-ed1f71b0-9ffd-4753-a97c-389687c109bd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.628626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:06.635782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381a4d044b1a41ca89ca2a75d6550800', 'request_id': 'req-ed1f71b0-9ffd-4753-a97c-389687c109bd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.652254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:06.660300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] The token cache is being invalidate because project 381a4d044b1a41ca89ca2a75d6550800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:06.661303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.662696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.673272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 997/1981] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:06 2022] DELETE /identity/v3/projects/381a4d044b1a41ca89ca2a75d6550800 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:06.674552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:06.677054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:06.703247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:06.704286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:06.704887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:06.705238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] PATH_INFO: `/v3/projects/adfc689c995848a19ef1561ec8aff831` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:06.707025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfc689c995848a19ef1561ec8aff831)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:06.709110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:06.782765 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f71b0-9ffd-4753-a97c-389687c109bd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:06.802366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfc689c995848a19ef1561ec8aff831', 'request_id': 'req-30bf5eef-bc7c-451a-a90a-28a3e03537e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.815376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfc689c995848a19ef1561ec8aff831', 'request_id': 'req-30bf5eef-bc7c-451a-a90a-28a3e03537e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.855571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfc689c995848a19ef1561ec8aff831', 'request_id': 'req-30bf5eef-bc7c-451a-a90a-28a3e03537e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.869099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:06.870389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:06.870746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:06.871169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] PATH_INFO: `/v3/projects/277263855d87420da4ab6e365e3cd9ff` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:06.872943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] RBAC: Authorizing `identity:delete_project(project_id=277263855d87420da4ab6e365e3cd9ff)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:06.876872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:06.895519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] The token cache is being invalidate because project adfc689c995848a19ef1561ec8aff831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:06.895811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.898294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30bf5eef-bc7c-451a-a90a-28a3e03537e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:06.905103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 985/1982] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:06 2022] DELETE /identity/v3/projects/adfc689c995848a19ef1561ec8aff831 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:06.907634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99519-c24f-4abb-920e-9de988cb3fce None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:06.908117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99519-c24f-4abb-920e-9de988cb3fce None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:06.908419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99519-c24f-4abb-920e-9de988cb3fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:06.952327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-11b99519-c24f-4abb-920e-9de988cb3fce None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:06.956089 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11b99519-c24f-4abb-920e-9de988cb3fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:06.974764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 986/1983] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:06.976348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd26873-bd07-4b0e-9439-22259ef9a588 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:06.976639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd26873-bd07-4b0e-9439-22259ef9a588 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:06.976914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd26873-bd07-4b0e-9439-22259ef9a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.006530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277263855d87420da4ab6e365e3cd9ff', 'request_id': 'req-e2e41abf-15dd-4013-8442-09a9a499426e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:07.015933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-acd26873-bd07-4b0e-9439-22259ef9a588 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:07.017508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-acd26873-bd07-4b0e-9439-22259ef9a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:07.025033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277263855d87420da4ab6e365e3cd9ff', 'request_id': 'req-e2e41abf-15dd-4013-8442-09a9a499426e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:07.049175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277263855d87420da4ab6e365e3cd9ff', 'request_id': 'req-e2e41abf-15dd-4013-8442-09a9a499426e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:07.102107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] The token cache is being invalidate because project 277263855d87420da4ab6e365e3cd9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:07.102590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:07.103713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e2e41abf-15dd-4013-8442-09a9a499426e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:07.107084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 998/1984] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:06 2022] DELETE /identity/v3/projects/277263855d87420da4ab6e365e3cd9ff => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:07.120258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45d22-8a0f-427e-bf85-0e044aab38bc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.120769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45d22-8a0f-427e-bf85-0e044aab38bc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.121268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45d22-8a0f-427e-bf85-0e044aab38bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.181090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9db45d22-8a0f-427e-bf85-0e044aab38bc None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:07.183164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 987/1985] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:07.183601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9db45d22-8a0f-427e-bf85-0e044aab38bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:07.185889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.186212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.186491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.201503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 999/1986] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:07.204883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034997-3941-47fa-931d-c61bdfbdde49 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.205386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034997-3941-47fa-931d-c61bdfbdde49 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.205874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034997-3941-47fa-931d-c61bdfbdde49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.223644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:07.225760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:07.235474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 988/1987] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:07.244169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.267786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fa034997-3941-47fa-931d-c61bdfbdde49 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:07.270161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fa034997-3941-47fa-931d-c61bdfbdde49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:07.274425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f708447-4ec0-4ae0-a810-3a1de5e92916 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.284228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.285416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.286051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1000/1988] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:07.286628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.286816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.288140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.288264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:07.288581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.288738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.288891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.292011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.317131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 989/1989] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:07.318767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.325050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:07.327508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:07.349552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d210-6fce-4119-8e59-be9438a142a3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.356226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1001/1990] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:07.358567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.368275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.371713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.372228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.372739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.378036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:07.378605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.386093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.394173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a4c38-6ca7-45a0-9070-11b75a754ac1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.406363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.407303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.407698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.408079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.408910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.412073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.413372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 990/1991] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:07.415051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.437765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a8c6-1902-43ef-963b-34ea1dc16c12 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.448161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.448690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:07.449622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.449769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.450293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.451810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:07.452289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.456413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.465697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:07.473102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 991/1992] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:07.475963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.484760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f232c-1915-4a49-9a2f-72df0ed26336 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.493243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1002/1993] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:07.493243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.500602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.501268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.501496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.501817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.502876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.516128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.569518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 992/1994] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:07.571607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.692167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c97a-af6a-4a81-b340-7bd27ab6cd04 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.705769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e22e8-1dde-4d68-9d9e-8a312c02f1ab admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.713503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.714668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.714746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.715003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.715135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:07.715687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:07.715868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.715962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:07.716240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:07.716947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:07.718264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.720230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:07.755246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 993/1995] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:07.756092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.780770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1003/1996] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:07.781489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:07.798018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad424a2-89fa-4461-bf03-ee4f2ba49294 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:07.994800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab619-5f22-4f29-8dd8-f67cd3dae9ae admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.001751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.002996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.003374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.003735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.004689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.006566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.020863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1004/1997] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:08.021943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.044287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.046778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.047722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.048327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.050273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.053772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5cf88-dec6-4ac7-a981-29ca0590060c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.054903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.060218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.061084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.061502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.061921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.063252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.066165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.100301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1005/1998] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:08 2022] POST /identity/v3/users => generated 291 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:08.101477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.164699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 994/1999] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:07 2022] POST /identity/v3/users => generated 291 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:08.166983 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.176728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092843-48f9-4742-ad16-10891cce76cd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.192157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01feb3-3014-46b2-86d9-8b48b94a2f41 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.199659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.200409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.201077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.201636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.202012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.202204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.202736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.202940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.203910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.204173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.207086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.211007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.222312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 995/2000] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:08.224440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.240578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830840a9-e350-4f06-8346-fdb4f3d2273a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.248924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.250687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.251582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.252323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.253658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.263633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1006/2001] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:08.265438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.273714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.302320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f1462-349e-4a8b-961b-90ee589547ec admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.328335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 996/2002] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:08.329593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.333372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.335850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.336339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.336802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.338929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.342232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.373358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae76d8e-2ee6-4e0b-983e-60520c1e8db7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.376543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1007/2003] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:08.378019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.385899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.388682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.390933 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.391535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] PATH_INFO: `/v3/projects/c1035e52e9ff413a96140839c9f6192e/users/2cd9d0db9b964ae5ad46b2abbe257448/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.405142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a061e-090e-459e-94e9-db7600a81da9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.419366 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.421051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.422173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.422636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.429118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.429118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.430629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1035e52e9ff413a96140839c9f6192e, user_id=2cd9d0db9b964ae5ad46b2abbe257448, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.434043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.448877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1008/2004] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:08.449766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.454901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 997/2005] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:08 2022] PUT /identity/v3/projects/c1035e52e9ff413a96140839c9f6192e/users/2cd9d0db9b964ae5ad46b2abbe257448/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:08.457315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.464554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ab13-d066-420d-84b5-1987ce0c1ae2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.471276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:08.523695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:08.622022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e88c3-1bd9-46d7-8234-139de47f2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.624440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e88c3-1bd9-46d7-8234-139de47f2440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.626003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e88c3-1bd9-46d7-8234-139de47f2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.628181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e88c3-1bd9-46d7-8234-139de47f2440 admin admin] PATH_INFO: `/v3/projects/44dd6a38668545b9beb1f3eaf46c246d/users/22cf40d7ecd04de38f419fbae430a243/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.640858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb8687-c76e-4f62-b38c-57c6e505fb12 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.652479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.654228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.654638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.655262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] PATH_INFO: `/v3/projects/850a617cafa44a0db3ea49a4bddf8780/users/d12692f78cb0460ea8b4a7c04e90c831/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.662231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e88c3-1bd9-46d7-8234-139de47f2440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44dd6a38668545b9beb1f3eaf46c246d, user_id=22cf40d7ecd04de38f419fbae430a243, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.665656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e88c3-1bd9-46d7-8234-139de47f2440 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.697158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1009/2006] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:08 2022] PUT /identity/v3/projects/44dd6a38668545b9beb1f3eaf46c246d/users/22cf40d7ecd04de38f419fbae430a243/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:08.699512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8c21d-18aa-42a6-9e89-e8a4958d4249 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.700002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8c21d-18aa-42a6-9e89-e8a4958d4249 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.700500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8c21d-18aa-42a6-9e89-e8a4958d4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.724296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=850a617cafa44a0db3ea49a4bddf8780, user_id=d12692f78cb0460ea8b4a7c04e90c831, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.727260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.752378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 998/2007] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:08 2022] PUT /identity/v3/projects/850a617cafa44a0db3ea49a4bddf8780/users/d12692f78cb0460ea8b4a7c04e90c831/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:08.754457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:08.764691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9ce8c21d-18aa-42a6-9e89-e8a4958d4249 None None] MFA Rules not processed for user `2cd9d0db9b964ae5ad46b2abbe257448`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:08.766105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:08.767562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9ce8c21d-18aa-42a6-9e89-e8a4958d4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:08.874815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1010/2008] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:08.876177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.876464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.876741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.880016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7d696-7c72-496c-bc66-be0552d52ceb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:08.893083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:08.894475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:08.895182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:08.895467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] PATH_INFO: `/v3/users/336b6e02a252451c92bc75ecbc67d445` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:08.898170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336b6e02a252451c92bc75ecbc67d445)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:08.902028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:08.925105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] MFA Rules not processed for user `22cf40d7ecd04de38f419fbae430a243`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:08.928267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:08.976623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336b6e02a252451c92bc75ecbc67d445'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:09.006620 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336b6e02a252451c92bc75ecbc67d445'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:09.025330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336b6e02a252451c92bc75ecbc67d445'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:09.026425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336b6e02a252451c92bc75ecbc67d445'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:09.047222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7c66c2b0-88ea-4b50-bb82-fba49196b867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336b6e02a252451c92bc75ecbc67d445'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:09.059047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 999/2009] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:08 2022] DELETE /identity/v3/users/336b6e02a252451c92bc75ecbc67d445 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:09.061057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1519a-9035-44d7-bc94-30afe0eb5cc0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.061712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1519a-9035-44d7-bc94-30afe0eb5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.062832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1519a-9035-44d7-bc94-30afe0eb5cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.069252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1011/2010] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:09.069252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.074422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:09.103384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1244840-96a7-45e1-af5e-be6567db03f3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.105072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:09.116387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-77d1519a-9035-44d7-bc94-30afe0eb5cc0 None None] MFA Rules not processed for user `d12692f78cb0460ea8b4a7c04e90c831`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:09.119387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-77d1519a-9035-44d7-bc94-30afe0eb5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:09.163169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:09.224319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.225164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.225624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.226068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.226239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1000/2011] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:09.233117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.233346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.233346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.233346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.233777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.262591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:09.263834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:09.268451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1012/2012] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:09.269690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.271953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:09.275335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1001/2013] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:09.276422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.277890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:09.299504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a58a-9be8-42b4-ab6c-a6a969dfb6bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.369293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d84609-7019-4efe-830a-eba725f5ce7e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.377784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.378963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.379465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.379965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.381251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.385169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.396274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.397874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.398454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.399035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.400287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.403905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.444895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1013/2014] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:09.444895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.451836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1002/2015] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:09.453634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.459019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:09.553213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d6b9e-0ea1-4178-86b5-16f510e67c47 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.571552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c06635-36b4-4950-b775-7bccca86cdd1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.575705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.576407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.576690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.576962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.619480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:09.629667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:09.662721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46694895-a344-450a-90da-c16a56620805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.664076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46694895-a344-450a-90da-c16a56620805 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.664671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46694895-a344-450a-90da-c16a56620805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.665623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46694895-a344-450a-90da-c16a56620805 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.666660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46694895-a344-450a-90da-c16a56620805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.670637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46694895-a344-450a-90da-c16a56620805 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.691501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.694901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.714324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1003/2016] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:09.715785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.720788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1014/2017] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:09.720788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46694895-a344-450a-90da-c16a56620805 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.736774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb208c-a01e-4640-92f5-403e942fb048 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.745515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.746753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.747262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.747767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.749082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.749344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46694895-a344-450a-90da-c16a56620805 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.754285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.760894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.762355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.762893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.764149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.765937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.769555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.795223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1004/2018] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/users => generated 298 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:09.797579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.810470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1015/2019] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:09 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:09.812241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.818152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73935-fb4b-4afe-aa2b-d8a0d969d11b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.826507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a6cd6-160e-4ebb-a582-f8f03827f435 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.829084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.831163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.831854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.832572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.832945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.833648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.833983 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.834333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.834603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.834992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.836902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.838866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.852425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1016/2020] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:09.853492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.858216 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1005/2021] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:09.860374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.872163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6109f8-e99c-4672-90c6-76386b4021c0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.877424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c20065-2200-41e3-83ae-78a9e6a3ede0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.880479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.881583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.882105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.882565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.883807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.885109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:09.886637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:09.886850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.887084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:09.887539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] PATH_INFO: `/v3/projects/c3a8fd088b224e679a1e65c92dd7e9fe/users/e4e33c2d333c42f283231d688fdda158/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:09.910089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1017/2022] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:09.910792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a8fd088b224e679a1e65c92dd7e9fe, user_id=e4e33c2d333c42f283231d688fdda158, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:09.911977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:09.914711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:09.932019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faa6e0-e54d-4f5f-bd03-4bc3b4f3c170 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:09.933644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1006/2023] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:09 2022] PUT /identity/v3/projects/c3a8fd088b224e679a1e65c92dd7e9fe/users/e4e33c2d333c42f283231d688fdda158/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:09.934665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.031829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd9e29-249d-4bf8-8405-f36ce35e3a65 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.037562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.038523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.038817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.039097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] PATH_INFO: `/v3/projects/1a2422c53fb04f9586acfe23c3f7d16c/users/238ff24724464ab1a0c3c4febcd2b645/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.040796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.042655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.043141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.043639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] PATH_INFO: `/v3/projects/f8d7660a36e64f87873e3c114787c950/users/fd2983288a914a7ea18d94864404aea4/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.061364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2422c53fb04f9586acfe23c3f7d16c, user_id=238ff24724464ab1a0c3c4febcd2b645, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.065074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.079173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7660a36e64f87873e3c114787c950, user_id=fd2983288a914a7ea18d94864404aea4, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.087842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.088090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1018/2024] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:09 2022] PUT /identity/v3/projects/1a2422c53fb04f9586acfe23c3f7d16c/users/238ff24724464ab1a0c3c4febcd2b645/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:10.088418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.126132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1007/2025] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:09 2022] PUT /identity/v3/projects/f8d7660a36e64f87873e3c114787c950/users/fd2983288a914a7ea18d94864404aea4/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:10.128751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.265172 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c29f8-923f-4252-af32-8e9ef4098c10 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.324679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:10.333755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b875e-96aa-493a-9a08-485c5b69d723 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.357946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.359353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.359904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.360759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.362388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.366487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.370366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:10.404370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1008/2026] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:10.405376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.422112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9a84-e285-41cd-adad-af62fe2b15de admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.427583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.428379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.428838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.429591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.429591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.429946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.431532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.431787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.432558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.433393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.435138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.439314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.449390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1009/2027] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:10.449390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.458035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b469989-5291-4d1c-9e56-956e6b61b337 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.463558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.464566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.464900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.465251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] PATH_INFO: `/v3/projects/1a2422c53fb04f9586acfe23c3f7d16c/users/238ff24724464ab1a0c3c4febcd2b645/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.473143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1019/2028] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:10.475915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.481591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2422c53fb04f9586acfe23c3f7d16c, user_id=238ff24724464ab1a0c3c4febcd2b645, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.490540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.501950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc44-03ea-4c0c-b70f-46ccffc7b0a4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.511764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1010/2029] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:10 2022] PUT /identity/v3/projects/1a2422c53fb04f9586acfe23c3f7d16c/users/238ff24724464ab1a0c3c4febcd2b645/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:10.521332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.636771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.636771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.636771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.636771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] PATH_INFO: `/v3/projects/f8d7660a36e64f87873e3c114787c950/users/fd2983288a914a7ea18d94864404aea4/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.637395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c847c-f9b4-4ab8-b0e8-76e3b39996c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.640682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7660a36e64f87873e3c114787c950, user_id=fd2983288a914a7ea18d94864404aea4, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.645929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56e9ce-e8f1-4823-b6f4-8df9230f1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.648737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.649085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56e9ce-e8f1-4823-b6f4-8df9230f1653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.649085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56e9ce-e8f1-4823-b6f4-8df9230f1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.649506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56e9ce-e8f1-4823-b6f4-8df9230f1653 admin admin] PATH_INFO: `/v3/projects/c3a8fd088b224e679a1e65c92dd7e9fe/users/e4e33c2d333c42f283231d688fdda158/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.653716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56e9ce-e8f1-4823-b6f4-8df9230f1653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a8fd088b224e679a1e65c92dd7e9fe, user_id=e4e33c2d333c42f283231d688fdda158, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.660342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56e9ce-e8f1-4823-b6f4-8df9230f1653 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.693896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1011/2031] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:10 2022] PUT /identity/v3/projects/c3a8fd088b224e679a1e65c92dd7e9fe/users/e4e33c2d333c42f283231d688fdda158/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:10.693896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b19b-69e1-4db1-b67e-1379c1e02d30 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.693896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b19b-69e1-4db1-b67e-1379c1e02d30 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.693896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b19b-69e1-4db1-b67e-1379c1e02d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.694381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1020/2031] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:10 2022] PUT /identity/v3/projects/f8d7660a36e64f87873e3c114787c950/users/fd2983288a914a7ea18d94864404aea4/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:10.694381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:10.695680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:10.743271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9692b19b-69e1-4db1-b67e-1379c1e02d30 None None] MFA Rules not processed for user `238ff24724464ab1a0c3c4febcd2b645`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:10.745467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9692b19b-69e1-4db1-b67e-1379c1e02d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:10.818589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55a94-53d6-456e-af68-4079b92c5bfc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:10.874948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1012/2032] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:10.878244 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900975e-74f3-4ab6-9b5b-13cc8fd9998f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.878741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900975e-74f3-4ab6-9b5b-13cc8fd9998f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.879224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900975e-74f3-4ab6-9b5b-13cc8fd9998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.913821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:10.914984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:10.915301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4900975e-74f3-4ab6-9b5b-13cc8fd9998f None None] MFA Rules not processed for user `fd2983288a914a7ea18d94864404aea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:10.915435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:10.915815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] PATH_INFO: `/v3/projects/37ff9235e5ed431bb91367c06efc22b5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:10.917254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4900975e-74f3-4ab6-9b5b-13cc8fd9998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:10.918103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ff9235e5ed431bb91367c06efc22b5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:10.920169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:10.924334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:10.981767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:11.008691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ff9235e5ed431bb91367c06efc22b5', 'request_id': 'req-9e419ea4-b413-4a6d-8098-750b03226efc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.019346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ff9235e5ed431bb91367c06efc22b5', 'request_id': 'req-9e419ea4-b413-4a6d-8098-750b03226efc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.027804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1013/2033] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:11.029334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.029722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.030079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.034911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ff9235e5ed431bb91367c06efc22b5', 'request_id': 'req-9e419ea4-b413-4a6d-8098-750b03226efc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.059040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] The token cache is being invalidate because project 37ff9235e5ed431bb91367c06efc22b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:11.059591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.060997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9e419ea4-b413-4a6d-8098-750b03226efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.065124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1021/2034] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:10 2022] DELETE /identity/v3/projects/37ff9235e5ed431bb91367c06efc22b5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:11.067611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992faa-cfe0-4f25-ab30-f259a600b21b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.068258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992faa-cfe0-4f25-ab30-f259a600b21b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.068612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992faa-cfe0-4f25-ab30-f259a600b21b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.068773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] MFA Rules not processed for user `e4e33c2d333c42f283231d688fdda158`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:11.070194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.071352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1022/2035] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:25:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:25:11.072802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d992faa-cfe0-4f25-ab30-f259a600b21b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:11.075518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3d992faa-cfe0-4f25-ab30-f259a600b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.154196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d992faa-cfe0-4f25-ab30-f259a600b21b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:11.158578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:11.159249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.159536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.159820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.161696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.185232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1014/2036] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:11.187424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:11.189663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.239914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:11.241289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:11.256400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1023/2037] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:11.260050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:11.263057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.286145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f20d3-6956-4086-afb1-04c27a45fcf6 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:11.294530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f7aeb-c2e2-4b15-a0f3-0563180e07c9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:11.295859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:11.297355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.298151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.298661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.303940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.305103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:11.307125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.307597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.308113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] PATH_INFO: `/v3/users/3edda370ad374be6bcd7f6ac2831b98f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.310285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3edda370ad374be6bcd7f6ac2831b98f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:11.314337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:11.393431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:11.413661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3edda370ad374be6bcd7f6ac2831b98f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.435740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:11.437642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:11.438830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3edda370ad374be6bcd7f6ac2831b98f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.439897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:11.451581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3edda370ad374be6bcd7f6ac2831b98f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.453021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3edda370ad374be6bcd7f6ac2831b98f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.457507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1024/2038] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:11.458553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:11.460297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.463839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-395953cc-79c1-4794-aba7-da4abb0a7b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3edda370ad374be6bcd7f6ac2831b98f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.473706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1015/2039] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:11 2022] DELETE /identity/v3/users/3edda370ad374be6bcd7f6ac2831b98f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:11.477014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35715a-3985-4003-9b53-f6ae29a0ca5f service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:11.488844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.490372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.490869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.569341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:11.574032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.620552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:11.625146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.627495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.628052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] PATH_INFO: `/v3/users/cee4164f4a95436894504f6b37a4526a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.641063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee4164f4a95436894504f6b37a4526a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:11.646752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:11.754917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1016/2040] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:25:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:11.755980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:11.760906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.784959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee4164f4a95436894504f6b37a4526a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.788188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee4164f4a95436894504f6b37a4526a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.801375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee4164f4a95436894504f6b37a4526a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.812766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee4164f4a95436894504f6b37a4526a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.828387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee4164f4a95436894504f6b37a4526a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:11.841293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1025/2041] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:11 2022] DELETE /identity/v3/users/cee4164f4a95436894504f6b37a4526a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:11.841293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:11.842335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.920557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07d90c-dadb-4fa6-b215-599610d10adb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:11.924381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ab7d0-bea3-4c38-baa5-4bbbb05d5606 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:11.926649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:11.927578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.927980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.928850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:11.929043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.930050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:11.930050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:11.930400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:11.932604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.932801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:11.946063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:12.014273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:12.016273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:12.019838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:12.023552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:12.028149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1017/2042] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:12.029119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:12.030574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.038129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1026/2043] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:12.065828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:12.128725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bb844-ba74-4b6a-aab2-b4430a1c62c1 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:12.136265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:12.136948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:12.137231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:12.137506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:12.139570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.156740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:12.158471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:12.171535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1018/2044] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:12.237037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:12.239138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.258859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd20b-9511-47ce-991e-99080a649945 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:12.264397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:12.265997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:12.265997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:12.266310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:12.275005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.386568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:12.388576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:12.400663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1027/2045] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:12.436312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:12.464263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770159fd-d0c6-403e-8a51-f8ef259eb792 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:12.479439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:12.484281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.488347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:12.496753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:12.497272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:12.497880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:12.506112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.658741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:12.661997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:12.676286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213cbba-b145-4fee-a850-15b626b51f80 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:12.691011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:12.691889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:12.692178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:12.693625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1019/2046] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:12.694524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] PATH_INFO: `/v3/projects/4e795682eb3f48afbdd6f8e5d074762b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:12.701825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e795682eb3f48afbdd6f8e5d074762b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:12.708115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:12.803215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:12.805893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:12.866359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e795682eb3f48afbdd6f8e5d074762b', 'request_id': 'req-81151172-8e55-4e14-954b-57cef285029f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:12.868369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:12.869996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5310e-fa38-4eef-a91f-fcd3efbdbb23 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:12.884959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e795682eb3f48afbdd6f8e5d074762b', 'request_id': 'req-81151172-8e55-4e14-954b-57cef285029f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:12.894847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e795682eb3f48afbdd6f8e5d074762b', 'request_id': 'req-81151172-8e55-4e14-954b-57cef285029f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:12.945530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] The token cache is being invalidate because project 4e795682eb3f48afbdd6f8e5d074762b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:12.946103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:12.948669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81151172-8e55-4e14-954b-57cef285029f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:12.951406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1028/2047] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:12 2022] DELETE /identity/v3/projects/4e795682eb3f48afbdd6f8e5d074762b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:12.957761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35bf4-4b64-4360-b3d9-3037caa3d617 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:12.958085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35bf4-4b64-4360-b3d9-3037caa3d617 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:12.959095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35bf4-4b64-4360-b3d9-3037caa3d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:12.988795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5fd35bf4-4b64-4360-b3d9-3037caa3d617 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:12.990633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5fd35bf4-4b64-4360-b3d9-3037caa3d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.033390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.034431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.034718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.034992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] PATH_INFO: `/v3/projects/cdf08c9b7de14054985ed371c2231190` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.036698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf08c9b7de14054985ed371c2231190)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.041442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.135406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf08c9b7de14054985ed371c2231190', 'request_id': 'req-ece3f6be-13d5-4c2f-b144-3a975b08dc97'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.149624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:13.151928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf08c9b7de14054985ed371c2231190', 'request_id': 'req-ece3f6be-13d5-4c2f-b144-3a975b08dc97'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.163084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf08c9b7de14054985ed371c2231190', 'request_id': 'req-ece3f6be-13d5-4c2f-b144-3a975b08dc97'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.186530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] The token cache is being invalidate because project cdf08c9b7de14054985ed371c2231190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:13.187465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.189381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ece3f6be-13d5-4c2f-b144-3a975b08dc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.196367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1020/2048] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:12 2022] DELETE /identity/v3/projects/cdf08c9b7de14054985ed371c2231190 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:13.204346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab454-bf69-4787-8a1a-ae36db5459e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.204940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab454-bf69-4787-8a1a-ae36db5459e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.205381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab454-bf69-4787-8a1a-ae36db5459e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.208514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1029/2049] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:13.218896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.219411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.224737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.235227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-376ab454-bf69-4787-8a1a-ae36db5459e2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:13.236721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-376ab454-bf69-4787-8a1a-ae36db5459e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.321326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:13.331644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.352586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1021/2050] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:13.354188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.354480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.354791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.371479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1030/2051] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:13.372975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.418049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ff4d2-702a-481c-9956-5fd9b039c0c2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.438594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:13.439864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.442869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.444506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.445196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.445784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.447173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:13.448125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.451509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.475665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1022/2052] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:13.476685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.491114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.492031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1031/2053] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:13.493487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.512117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc144a9-9dd6-4fab-a324-f4e6bed7a739 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.522795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2aa0-07c0-4461-a193-81e5a5f74b5b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.531075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.532102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.532398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.532690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] PATH_INFO: `/v3/users/22cf40d7ecd04de38f419fbae430a243` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.535985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.536679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.536963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.537240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.537935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cf40d7ecd04de38f419fbae430a243)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.538200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:13.538329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.540018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.540186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.571813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1032/2054] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:13.572529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.596641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd38da1-be4c-47c1-aa7b-23ef4ce3678c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.604123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.604802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.605468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.605766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.606514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.610065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.664018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1033/2055] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:13.665247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.669411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cf40d7ecd04de38f419fbae430a243'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.703735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cf40d7ecd04de38f419fbae430a243'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.716922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cf40d7ecd04de38f419fbae430a243'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.718273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cf40d7ecd04de38f419fbae430a243'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.730657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cf40d7ecd04de38f419fbae430a243'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:13.738680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1023/2056] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:13 2022] DELETE /identity/v3/users/22cf40d7ecd04de38f419fbae430a243 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:13.739604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.741571 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.804696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9638db-171f-4347-9bd4-c9c88316fe2b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.809882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:13.825885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08023f92-50a0-47af-9050-4658ce619c91 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.834837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bbac9-0add-4c74-9257-d688dcdda5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.835564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bbac9-0add-4c74-9257-d688dcdda5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.835845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bbac9-0add-4c74-9257-d688dcdda5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.836273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bbac9-0add-4c74-9257-d688dcdda5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.837136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bbac9-0add-4c74-9257-d688dcdda5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.840996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bbac9-0add-4c74-9257-d688dcdda5b3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.864798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:13.873467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1024/2057] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:13.873467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.873467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.873467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.903347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:13.905640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:13.922185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1025/2058] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:13.923869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.947065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.948270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.948818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.949454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.950813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.954977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.955546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f425-91de-4058-9bab-594c8fade7cc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:13.963673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:13.964952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:13.965556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:13.966194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:13.967663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:13.970603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:13.986322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1026/2059] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:13.987812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:13.990331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:14.013436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1034/2060] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:13 2022] POST /identity/v3/projects => generated 377 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:14.015956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.101100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313637b0-ae08-4dd0-870f-493521397307 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.148597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315588b-c975-426b-aaba-b8efb2831454 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.158546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.159666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.160231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.161396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.163176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.166299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.173427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.174195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.174476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.175269 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.181657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1035/2061] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:14.182634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.185272 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:14.192140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.195491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.213870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16582283-26b1-4ea2-a633-763b2ad93aa8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.216733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1027/2062] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:14.218179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.226638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.228625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.228934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.229801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.230581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.236719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.239463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b26df-3a98-4242-ba38-430387f6b02d service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.250326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2c40-1259-46b2-b4b9-5d9d4691e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.252023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2c40-1259-46b2-b4b9-5d9d4691e948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.252496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2c40-1259-46b2-b4b9-5d9d4691e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.253410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2c40-1259-46b2-b4b9-5d9d4691e948 admin admin] PATH_INFO: `/v3/projects/b09fb0dcd7bb437fa67b973ddd9cdddc/users/144457df5bd2420796f8f8d6bbce7c0c/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.287170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2c40-1259-46b2-b4b9-5d9d4691e948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09fb0dcd7bb437fa67b973ddd9cdddc, user_id=144457df5bd2420796f8f8d6bbce7c0c, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.295428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2c40-1259-46b2-b4b9-5d9d4691e948 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.312416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1036/2063] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:14 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:14.314862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.323781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1028/2064] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:14 2022] PUT /identity/v3/projects/b09fb0dcd7bb437fa67b973ddd9cdddc/users/144457df5bd2420796f8f8d6bbce7c0c/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:14.331891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.332464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.332996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.339289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba3547-ddda-4eae-9470-1e64bbec08a5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.361552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:14.363288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:14.459801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.461156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.461341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.461744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.463533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.465357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.469638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:14.484545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1037/2065] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:14.490323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.508106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1029/2066] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:14.517221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.526590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152410-5443-4a42-9ce5-77f3beac4db0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.534636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.535848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.536358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.536860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.538361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.541655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.571030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1038/2067] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:14.573154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.590024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a72d-c2e4-4f3e-b313-6358910bb173 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.599986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a99dd-aa32-49d7-9989-35d36af123fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.601580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a99dd-aa32-49d7-9989-35d36af123fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.601887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a99dd-aa32-49d7-9989-35d36af123fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.602407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a99dd-aa32-49d7-9989-35d36af123fc admin admin] PATH_INFO: `/v3/projects/b5cdf3741b304ad097c79641683c0382/users/36840e8ac3a14cdc9c5b4831ce34d770/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.622231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a99dd-aa32-49d7-9989-35d36af123fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cdf3741b304ad097c79641683c0382, user_id=36840e8ac3a14cdc9c5b4831ce34d770, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.625676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a99dd-aa32-49d7-9989-35d36af123fc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:14.629517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:14.659058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1039/2068] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:14 2022] PUT /identity/v3/projects/b5cdf3741b304ad097c79641683c0382/users/36840e8ac3a14cdc9c5b4831ce34d770/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:14.665640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.665640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.665640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.684841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed3d3f-75a4-41d3-bb83-1526d19a5340 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.704875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] MFA Rules not processed for user `36840e8ac3a14cdc9c5b4831ce34d770`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:14.706903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:14.805901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.807126 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.807633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.808156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.862003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1040/2069] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:14.862003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:14.971624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b4c31-d7f5-46cd-95e7-b092416e85ca None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:14.978851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:14.979736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:14.979886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:14.980169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:14.981130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:14.983446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.015632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.019302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.039641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1030/2070] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:15.041166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.043099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1041/2071] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:14 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:15.043880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:15.044260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.074221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b39f1-1cc8-44c4-96fa-0879ab116fec service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:15.214756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5152b-bf77-4d9d-9e2d-50eac590eb06 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:15.216362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:15.220634 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:15.221002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.221321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.221611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.221720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.221934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.222195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] PATH_INFO: `/v3/projects/44dd6a38668545b9beb1f3eaf46c246d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.222714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.224869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.226343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44dd6a38668545b9beb1f3eaf46c246d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.240820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.247373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:15.252704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1042/2072] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:15 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:15.258592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.271598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:15.272927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec125-5f70-4178-9355-ab17f91cdd0b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:15.284624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:15.286156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.286519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.287294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.288238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.290685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.311915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1043/2073] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:15.313056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.324754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478adc1-bbce-4137-b950-18541f123320 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:15.338173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:15.339859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.340419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.341168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.343868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.346544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.389512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1044/2074] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:15.395010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.407193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44dd6a38668545b9beb1f3eaf46c246d', 'request_id': 'req-ac9deaa6-d966-4068-a74a-22121f9cf8b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.425549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114697fc-433e-4449-86b8-ac516b01c745 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:15.432829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44dd6a38668545b9beb1f3eaf46c246d', 'request_id': 'req-ac9deaa6-d966-4068-a74a-22121f9cf8b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.464971 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44dd6a38668545b9beb1f3eaf46c246d', 'request_id': 'req-ac9deaa6-d966-4068-a74a-22121f9cf8b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.506272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] The token cache is being invalidate because project 44dd6a38668545b9beb1f3eaf46c246d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:15.507383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.527111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.533573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1031/2075] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:15 2022] DELETE /identity/v3/projects/44dd6a38668545b9beb1f3eaf46c246d => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:15.535064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.537352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:15.658219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63250581-4aac-4b27-a202-1cdda647e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:15.661199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250581-4aac-4b27-a202-1cdda647e5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.662140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250581-4aac-4b27-a202-1cdda647e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.665175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250581-4aac-4b27-a202-1cdda647e5a2 admin admin] PATH_INFO: `/v3/projects/0b9d2e73f95a4a6599be6e16d0299228/users/a430f7d12ea44788b454e24a47d3f21d/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.700683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9deaa6-d966-4068-a74a-22121f9cf8b3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:15.704104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63250581-4aac-4b27-a202-1cdda647e5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9d2e73f95a4a6599be6e16d0299228, user_id=a430f7d12ea44788b454e24a47d3f21d, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.707629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63250581-4aac-4b27-a202-1cdda647e5a2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.713251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:15.714380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.714673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.714958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] PATH_INFO: `/v3/users/e4e33c2d333c42f283231d688fdda158` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.718820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e33c2d333c42f283231d688fdda158)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:15.720912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:15.751355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1045/2076] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:15 2022] PUT /identity/v3/projects/0b9d2e73f95a4a6599be6e16d0299228/users/a430f7d12ea44788b454e24a47d3f21d/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:15.762804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:15.763097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:15.763533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:15.822694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] MFA Rules not processed for user `a430f7d12ea44788b454e24a47d3f21d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:15.824015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:15.836703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e33c2d333c42f283231d688fdda158'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.895645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e33c2d333c42f283231d688fdda158'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.915661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e33c2d333c42f283231d688fdda158'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.917074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e33c2d333c42f283231d688fdda158'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.930996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e33c2d333c42f283231d688fdda158'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:15.952783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1032/2077] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:15 2022] DELETE /identity/v3/users/e4e33c2d333c42f283231d688fdda158 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:15.976731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:15.978899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:15.981213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1046/2078] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:16.009170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:16.121038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175c65b-4f0f-4f0d-ac1c-26e0df3bdd17 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:16.144319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:16.145617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:16.146180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:16.146672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:16.147946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:16.151271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:16.198277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1033/2079] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:15 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:16.202093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:16.234814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:16.237019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:16.296765 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:16.323376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5607d1a-01b9-4afd-9238-a8c8bdeba775 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:16.364436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934c8be-cfa4-440d-b65a-1eae3af3205e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:16.386555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:16.389787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:16.390235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:16.390515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] PATH_INFO: `/v3/users/d12692f78cb0460ea8b4a7c04e90c831` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:16.393200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12692f78cb0460ea8b4a7c04e90c831)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:16.397627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:16.485102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:16.486393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:16.486861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:16.487146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:16.493995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:16.493995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:16.495734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12692f78cb0460ea8b4a7c04e90c831'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:16.521641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1047/2080] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:16 2022] POST /identity/v3/users => generated 296 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:16.526530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:16.532545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12692f78cb0460ea8b4a7c04e90c831'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:16.539402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110c7e-1c42-4849-8a58-1b6840afc44a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:16.547010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12692f78cb0460ea8b4a7c04e90c831'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:16.547176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:16.547782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:16.548346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:16.548635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:16.549517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:16.550145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12692f78cb0460ea8b4a7c04e90c831'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:16.551453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:16.569623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1048/2081] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:16.570041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd84583-434f-4fed-b356-ae1d9eacf89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12692f78cb0460ea8b4a7c04e90c831'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:16.570541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:16.572421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:16.587629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1034/2082] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:16 2022] DELETE /identity/v3/users/d12692f78cb0460ea8b4a7c04e90c831 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:16.587891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea315a13-3622-4efd-9357-39419e7334d4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:16.591069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:16.591372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:16.591664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:16.638528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:16.640654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:16.666335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:16.729667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:16.731426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:16.731888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:16.732401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] PATH_INFO: `/v3/projects/e4d7b4312d604d54aaad359da62210b3/users/7dae03992fe14858afdeef81a604333b/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:16.774030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1035/2083] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:16.792822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d7b4312d604d54aaad359da62210b3, user_id=7dae03992fe14858afdeef81a604333b, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:16.793103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:16.794641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:16.799199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:16.836270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1049/2084] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:16 2022] PUT /identity/v3/projects/e4d7b4312d604d54aaad359da62210b3/users/7dae03992fe14858afdeef81a604333b/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:16.844171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:16.867723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d0e5-b536-48d6-9b44-9ca929a62809 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.018742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56222db1-b72d-4cd5-bb7f-aed22ed3d5e5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.063639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.064459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.064973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.065485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.066701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.066981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.067852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.068313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.068777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.083699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.087745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:17.089451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.092388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.113559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1050/2086] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:17.113841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1036/2086] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:17.121687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.124677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:17.134667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.159692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2850981-01fc-46ba-b8d4-e6b75afeaff9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.163782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584586d-74aa-4342-baaa-3336b47eb111 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.170123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.171825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.173631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.174315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] PATH_INFO: `/v3/projects/c3a8fd088b224e679a1e65c92dd7e9fe` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.175298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ecfab-a076-42ff-a6bf-360ee237c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.178367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ecfab-a076-42ff-a6bf-360ee237c6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.179087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ecfab-a076-42ff-a6bf-360ee237c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.179733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ecfab-a076-42ff-a6bf-360ee237c6cc admin admin] PATH_INFO: `/v3/projects/e4d7b4312d604d54aaad359da62210b3/users/7dae03992fe14858afdeef81a604333b/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.185345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ecfab-a076-42ff-a6bf-360ee237c6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d7b4312d604d54aaad359da62210b3, user_id=7dae03992fe14858afdeef81a604333b, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.189204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a8fd088b224e679a1e65c92dd7e9fe)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.193676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.194360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ecfab-a076-42ff-a6bf-360ee237c6cc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.218905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1037/2087] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:17 2022] PUT /identity/v3/projects/e4d7b4312d604d54aaad359da62210b3/users/7dae03992fe14858afdeef81a604333b/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:17.231154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.231463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.231789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.291842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] MFA Rules not processed for user `7dae03992fe14858afdeef81a604333b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:17.294660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:17.330024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a8fd088b224e679a1e65c92dd7e9fe', 'request_id': 'req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:17.337450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a8fd088b224e679a1e65c92dd7e9fe', 'request_id': 'req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:17.349429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a8fd088b224e679a1e65c92dd7e9fe', 'request_id': 'req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:17.367361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] The token cache is being invalidate because project c3a8fd088b224e679a1e65c92dd7e9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:17.367911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:17.368788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6f32197f-50dc-4ba6-9b5c-a2ae4d82b995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:17.370850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1051/2088] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:17 2022] DELETE /identity/v3/projects/c3a8fd088b224e679a1e65c92dd7e9fe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:17.378769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179c31e-fb8e-44ff-a004-9df7eefab1a3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.380573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179c31e-fb8e-44ff-a004-9df7eefab1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.381054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179c31e-fb8e-44ff-a004-9df7eefab1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.416567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5179c31e-fb8e-44ff-a004-9df7eefab1a3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:17.418829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5179c31e-fb8e-44ff-a004-9df7eefab1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:17.446686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:17.494459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1038/2089] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:17.520638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.523072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:17.557066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1052/2090] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:17.570304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.570904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.571419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.599657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:17.601382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:17.617100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1053/2091] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:17.623868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.637918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ded28a-0a1b-42d9-af5d-8e41318b4756 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.646940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.647882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.648205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.648457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.649262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:17.649725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.652458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.673181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c7674-f864-47ec-bed1-dfc4f16029a0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.679757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1054/2092] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:17.681264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.696122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659e4dc-faf5-44ae-bd9d-c689289302d2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.702747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.704035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.705749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.706333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.707359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.709865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.768789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1055/2093] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:17 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:17.773011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.816723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.817417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.817810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.818517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.866889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:17.900389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c4c8a-4a31-44f8-a952-c6375c1ac59e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.906321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.907822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.908117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.908397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.909128 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.911487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.916253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.918490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:17.935670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1039/2094] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:17.949952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1056/2095] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:17 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:17.950533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:17.969568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e70119-ff7d-487e-b87c-03cd0cdcf277 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:17.980295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:17.982910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:17.983834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:17.984254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:17.985139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:17.987698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:18.005846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:18.010230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1040/2096] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:18.027412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:18.030458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:18.058538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27262-0424-47cd-b163-a6b44e29f8a8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:18.068127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:18.069647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:18.070462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:18.070951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:18.073349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:18.076807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:18.102209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1057/2097] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:18.107098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:18.125112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e278a9-23f6-4763-9e9b-ca086bce8e03 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:18.133382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602b164-e393-4430-8300-0189712b96cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:18.134588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b164-e393-4430-8300-0189712b96cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:18.134946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b164-e393-4430-8300-0189712b96cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:18.135507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602b164-e393-4430-8300-0189712b96cb admin admin] PATH_INFO: `/v3/projects/4756e8c0fadb4935a81509f0c11328f1/users/9209aaf1c19b48d4ba5f02d2e1d4775c/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:18.150532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:18.160327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602b164-e393-4430-8300-0189712b96cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4756e8c0fadb4935a81509f0c11328f1, user_id=9209aaf1c19b48d4ba5f02d2e1d4775c, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:18.163771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602b164-e393-4430-8300-0189712b96cb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:18.167021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203b474-3ce3-4b24-97ae-6d7ea4155c65 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:18.172074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:18.173088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:18.173367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:18.173752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:18.176521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:18.184004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1058/2098] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:18 2022] PUT /identity/v3/projects/4756e8c0fadb4935a81509f0c11328f1/users/9209aaf1c19b48d4ba5f02d2e1d4775c/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:18.196958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:18.197548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:18.198096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:18.267777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] MFA Rules not processed for user `9209aaf1c19b48d4ba5f02d2e1d4775c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:18.270038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:18.293052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:18.298888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:18.340572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1041/2099] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:18.524188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1059/2100] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:18.633409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:18.651849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86abdf-588c-4fad-ab13-0d7cbc7fe9cf service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:18.832264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:18.834186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:18.835105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:18.835331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:18.839845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:18.842153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:18.852027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:18.854283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:18.871180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1042/2101] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:19.038567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46db708-0bad-4482-ac8c-584ee30d741b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:19.045142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:19.048876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:19.049435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:19.049862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] PATH_INFO: `/v3/projects/850a617cafa44a0db3ea49a4bddf8780` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:19.051815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=850a617cafa44a0db3ea49a4bddf8780)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:19.054381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:19.102481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:19.168823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850a617cafa44a0db3ea49a4bddf8780', 'request_id': 'req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.191186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850a617cafa44a0db3ea49a4bddf8780', 'request_id': 'req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.201268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850a617cafa44a0db3ea49a4bddf8780', 'request_id': 'req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.231145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] The token cache is being invalidate because project 850a617cafa44a0db3ea49a4bddf8780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:19.231492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.235322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.245424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1060/2102] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:18 2022] DELETE /identity/v3/projects/850a617cafa44a0db3ea49a4bddf8780 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:19.246412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:19.266487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e75e-fcdf-4c8f-ab3c-a4995a314320 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:19.333151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:19.334843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:19.417569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:19.422063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:19.422602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:19.423100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] PATH_INFO: `/v3/users/fd2983288a914a7ea18d94864404aea4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:19.425084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2983288a914a7ea18d94864404aea4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:19.428990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:19.551181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:19.555127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2983288a914a7ea18d94864404aea4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.556369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d54bed-f7eb-4b7a-b13f-de2caf43e21d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:19.589885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2983288a914a7ea18d94864404aea4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.597178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:19.599010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:19.599528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:19.600014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] PATH_INFO: `/v3/users/2cd9d0db9b964ae5ad46b2abbe257448` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:19.602569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd9d0db9b964ae5ad46b2abbe257448)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:19.613838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:19.614844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2983288a914a7ea18d94864404aea4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.615798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2983288a914a7ea18d94864404aea4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.631350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-706ca039-078b-4828-916e-7fcc5fd0e48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2983288a914a7ea18d94864404aea4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.644100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1043/2103] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:19 2022] DELETE /identity/v3/users/fd2983288a914a7ea18d94864404aea4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:19.818925 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd9d0db9b964ae5ad46b2abbe257448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.820627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd9d0db9b964ae5ad46b2abbe257448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.837536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd9d0db9b964ae5ad46b2abbe257448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.855617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd9d0db9b964ae5ad46b2abbe257448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.891250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd9d0db9b964ae5ad46b2abbe257448'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:19.900991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1061/2104] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:19 2022] DELETE /identity/v3/users/2cd9d0db9b964ae5ad46b2abbe257448 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:19.907555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:19.909413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:19.909908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:19.942834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:19.945083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:20.140147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1044/2105] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:20.152742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:20.154701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:20.247190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:20.321785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaedbcb-a02c-4ea7-aa68-e912ab71f3c1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:20.331299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef97c9-ec6b-4c1f-9e9c-8d35a8eb5596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:20.332765 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef97c9-ec6b-4c1f-9e9c-8d35a8eb5596 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:20.334150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef97c9-ec6b-4c1f-9e9c-8d35a8eb5596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:20.334657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef97c9-ec6b-4c1f-9e9c-8d35a8eb5596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:20.361674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:20.362088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef97c9-ec6b-4c1f-9e9c-8d35a8eb5596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:20.364947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:20.369001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef97c9-ec6b-4c1f-9e9c-8d35a8eb5596 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:20.400384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1062/2106] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:20.403295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa60514-40fc-4fff-9b13-7b4e1abf8e96 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:20.442699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:20.445119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:20.446005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:20.447920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] PATH_INFO: `/v3/projects/f8d7660a36e64f87873e3c114787c950` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:20.451001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d7660a36e64f87873e3c114787c950)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:20.460206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:20.632419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d7660a36e64f87873e3c114787c950', 'request_id': 'req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:20.646854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d7660a36e64f87873e3c114787c950', 'request_id': 'req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:20.663535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d7660a36e64f87873e3c114787c950', 'request_id': 'req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:20.702248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] The token cache is being invalidate because project f8d7660a36e64f87873e3c114787c950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:20.702953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:20.706290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee1960ca-eca1-4c99-a4e0-71cd46e938ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:20.710389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1045/2107] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:20 2022] DELETE /identity/v3/projects/f8d7660a36e64f87873e3c114787c950 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:20.715076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:20.715364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:20.715881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:20.743641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:20.744842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:20.843701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1063/2108] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:20.849794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:20.849794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:20.850112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:20.900073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:20.919745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:20.981518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1046/2109] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:20.987629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.003231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f35d0-4988-4e14-8b6b-664d4c8bf250 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.019717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.020418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.020697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.020972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.021717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:21.022102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.023760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.064268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1064/2110] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:21.075663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.095368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179901e3-6b0a-4349-b038-4e074e9514a3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.119639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.120329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.120599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.121300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.122218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.124924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.211964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1047/2111] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:21 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:21.215284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.232181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306630af-68a2-4388-a8c2-71464adaefea admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.313885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.319577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:21.395090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:21.443222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.443826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.444107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.444376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.445494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.455891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.548750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1065/2112] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:21 2022] POST /identity/v3/users => generated 288 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:21.550212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.569116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2697-3df2-466a-bf80-ef2d17064841 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.586794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.589016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.590726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.591022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.593265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.597600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.614467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350f093-7f13-46c4-98f9-85d601cd7e05 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.627812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1066/2113] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:21.631721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.632079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.634719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.637114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.638261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] PATH_INFO: `/v3/projects/c1035e52e9ff413a96140839c9f6192e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.641981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1035e52e9ff413a96140839c9f6192e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.650214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.653755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8a443-2e36-4d50-8fa2-808538c8bae9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.666993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.668541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.669011 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.669449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.673034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.675148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.700511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1067/2114] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:21.705263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.731887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2ad5-5202-443f-a485-27a7ffd0b196 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:21.751992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f547de-47f2-4a5d-9f05-f80290065abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:21.755445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f547de-47f2-4a5d-9f05-f80290065abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.756494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f547de-47f2-4a5d-9f05-f80290065abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.757345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f547de-47f2-4a5d-9f05-f80290065abc admin admin] PATH_INFO: `/v3/projects/c6e52fac92f84cc48afc970edf306986/users/f220c486bf9c42e7a41eef7a6c40b22f/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.800053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f547de-47f2-4a5d-9f05-f80290065abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e52fac92f84cc48afc970edf306986, user_id=f220c486bf9c42e7a41eef7a6c40b22f, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:21.825901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f547de-47f2-4a5d-9f05-f80290065abc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:21.830354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1035e52e9ff413a96140839c9f6192e', 'request_id': 'req-7088af08-9423-438c-a11e-66d046debf40'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:21.860647 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1035e52e9ff413a96140839c9f6192e', 'request_id': 'req-7088af08-9423-438c-a11e-66d046debf40'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:21.890221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1035e52e9ff413a96140839c9f6192e', 'request_id': 'req-7088af08-9423-438c-a11e-66d046debf40'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:21.890854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1068/2115] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:21 2022] PUT /identity/v3/projects/c6e52fac92f84cc48afc970edf306986/users/f220c486bf9c42e7a41eef7a6c40b22f/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:21.910848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:21.916903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:21.917369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:21.934809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:21.940793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] The token cache is being invalidate because project c1035e52e9ff413a96140839c9f6192e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:21.941373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:21.941929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:21.946081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1048/2116] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:21 2022] DELETE /identity/v3/projects/c1035e52e9ff413a96140839c9f6192e => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:21.947997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:21.953934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:21.991114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] MFA Rules not processed for user `f220c486bf9c42e7a41eef7a6c40b22f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:21.993167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:22.140700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088af08-9423-438c-a11e-66d046debf40 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:22.168017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1069/2117] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:22.173423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:22.176727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:22.257095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:22.275110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:22.276117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:22.277045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:22.277805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] PATH_INFO: `/v3/users/238ff24724464ab1a0c3c4febcd2b645` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:22.280494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=238ff24724464ab1a0c3c4febcd2b645)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:22.282783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:22.344461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d5154-dbcc-43b2-88fd-fb50e88aa5f3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:22.354572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:22.356215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:22.356712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:22.357213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:22.359362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:22.363511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:22.398152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238ff24724464ab1a0c3c4febcd2b645'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:22.422291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238ff24724464ab1a0c3c4febcd2b645'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:22.446882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238ff24724464ab1a0c3c4febcd2b645'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:22.447690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238ff24724464ab1a0c3c4febcd2b645'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:22.466390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238ff24724464ab1a0c3c4febcd2b645'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:22.498847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1049/2118] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:21 2022] DELETE /identity/v3/users/238ff24724464ab1a0c3c4febcd2b645 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:22.500154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:22.502494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:22.503312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1070/2119] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:22 2022] POST /identity/v3/projects => generated 375 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:22.641095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd807765-9973-40c9-bdc2-36c103fe8a7a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:22.778935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:22.780475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:22.781295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:22.781804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:22.783434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:22.788556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:22.832941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1050/2120] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:22 2022] POST /identity/v3/users => generated 288 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:22.835092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:22.849900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fe9b9-7590-48fe-ad4e-0ef16f88b440 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:22.865135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:22.866492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:22.867108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:22.867413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:22.868412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:22.870156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:22.896198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1071/2121] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:22.897268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:22.915481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19f105-ed48-42fc-97ea-14a940beb76b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:22.923061 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:22.925289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:22.927354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:22.929392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:22.930131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:22.930409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:22.935569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:22.940218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:22.944970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:22.952661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7057f0-c1f3-4b7d-8e25-8b80c942f3ca admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:22.973772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:22.977182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:22.977830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:22.981324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] PATH_INFO: `/v3/users/36840e8ac3a14cdc9c5b4831ce34d770` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:22.981519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1051/2122] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:22.984924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:22.985789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36840e8ac3a14cdc9c5b4831ce34d770)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:22.996083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:23.026040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524285df-55db-4ecb-ade4-eba2c636ebce admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:23.053054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746d3aa-5d74-4a34-8e44-ea02ba77e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:23.055332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d3aa-5d74-4a34-8e44-ea02ba77e2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.056086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d3aa-5d74-4a34-8e44-ea02ba77e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.057386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746d3aa-5d74-4a34-8e44-ea02ba77e2f8 admin admin] PATH_INFO: `/v3/projects/b73dd990a6cb42a59b9c60b273d32569/users/23466ecd5849469aa1fb99bf93968f7e/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.118800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746d3aa-5d74-4a34-8e44-ea02ba77e2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73dd990a6cb42a59b9c60b273d32569, user_id=23466ecd5849469aa1fb99bf93968f7e, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:23.135949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746d3aa-5d74-4a34-8e44-ea02ba77e2f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:23.140825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36840e8ac3a14cdc9c5b4831ce34d770'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.141089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36840e8ac3a14cdc9c5b4831ce34d770'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.156900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36840e8ac3a14cdc9c5b4831ce34d770'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.173424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36840e8ac3a14cdc9c5b4831ce34d770'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.176426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:23.193198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1052/2123] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:22 2022] PUT /identity/v3/projects/b73dd990a6cb42a59b9c60b273d32569/users/23466ecd5849469aa1fb99bf93968f7e/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:23.203910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.205850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.207848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.209070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a31351b3-c69b-4607-b922-067908b15705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36840e8ac3a14cdc9c5b4831ce34d770'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.226599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1072/2124] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:22 2022] DELETE /identity/v3/users/36840e8ac3a14cdc9c5b4831ce34d770 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:23.246617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.246617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.246617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.280618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:23.283064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.304967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] MFA Rules not processed for user `23466ecd5849469aa1fb99bf93968f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:23.307398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.392093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1073/2125] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:23.393997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:23.396956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.416662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c83681-12af-4a71-afb2-a944bb0ab265 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:23.428234 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:23.429635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.430034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.430579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] PATH_INFO: `/v3/projects/1a2422c53fb04f9586acfe23c3f7d16c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.432353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2422c53fb04f9586acfe23c3f7d16c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:23.434959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:23.492251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1053/2126] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:23.493898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:23.496606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.520213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2422c53fb04f9586acfe23c3f7d16c', 'request_id': 'req-9622e414-8edb-490e-bab2-25620360797a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.531773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2422c53fb04f9586acfe23c3f7d16c', 'request_id': 'req-9622e414-8edb-490e-bab2-25620360797a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.543462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2422c53fb04f9586acfe23c3f7d16c', 'request_id': 'req-9622e414-8edb-490e-bab2-25620360797a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.570538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] The token cache is being invalidate because project 1a2422c53fb04f9586acfe23c3f7d16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:23.570859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.572488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:23.574981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1074/2127] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:23 2022] DELETE /identity/v3/projects/1a2422c53fb04f9586acfe23c3f7d16c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:23.576127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:23.578783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.673823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6a68-a907-453c-a76a-589f2d407f69 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:23.714364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622e414-8edb-490e-bab2-25620360797a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:23.722840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d2c28-c1be-4da7-a341-45c95f2881c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:23.723812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2c28-c1be-4da7-a341-45c95f2881c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.724106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2c28-c1be-4da7-a341-45c95f2881c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.724385 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d2c28-c1be-4da7-a341-45c95f2881c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.725104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2c28-c1be-4da7-a341-45c95f2881c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:23.728489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d2c28-c1be-4da7-a341-45c95f2881c0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:23.751418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:23.793731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1075/2128] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:23 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:23.800168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.800456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.800788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.821244 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:23.821920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:23.822228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:23.823697 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:23.831056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.851737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:23.853173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.865535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:23.869190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:23.909296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1054/2129] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:23.914261 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:23.918941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:23.952277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec819-6b76-47d9-a2c6-26a63e8b4b5f service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.002515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:24.017167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1076/2130] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:24.018223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.035213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048d87f-a0e9-483e-b4bd-05105a4628e4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.040807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038b0a-fd68-4546-90f3-e165caa0036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.041510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038b0a-fd68-4546-90f3-e165caa0036c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.041795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038b0a-fd68-4546-90f3-e165caa0036c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.042159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038b0a-fd68-4546-90f3-e165caa0036c admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.042934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1038b0a-fd68-4546-90f3-e165caa0036c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.045238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1038b0a-fd68-4546-90f3-e165caa0036c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.083666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1077/2131] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:24 2022] POST /identity/v3/users => generated 295 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:24.088259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.088526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.088803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.129243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.131287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.131802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.132301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] PATH_INFO: `/v3/users/9209aaf1c19b48d4ba5f02d2e1d4775c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.134556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:24.136069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:24.140290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9209aaf1c19b48d4ba5f02d2e1d4775c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.144399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.164110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1078/2132] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:24.167993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.202640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115bf6f-7d50-4498-b768-c33556659cc7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.226766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.227661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.228169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.228679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.230188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.234027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.255158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1079/2133] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:24.256734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.257147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9209aaf1c19b48d4ba5f02d2e1d4775c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:24.275259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7e9c-af74-4cfb-8c95-fe167933c784 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.283594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.284308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.284599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.284883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.285703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:24.286060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.286426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9209aaf1c19b48d4ba5f02d2e1d4775c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:24.287942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.307589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9209aaf1c19b48d4ba5f02d2e1d4775c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:24.309365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9209aaf1c19b48d4ba5f02d2e1d4775c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:24.321827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1080/2134] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:24.323379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.330285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:24.332552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9209aaf1c19b48d4ba5f02d2e1d4775c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:24.350678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1055/2135] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:23 2022] DELETE /identity/v3/users/9209aaf1c19b48d4ba5f02d2e1d4775c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:24.353029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.355705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39118556-88bf-475d-abaa-5e5ff9c67aed admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.360747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:24.498157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035581-1b1a-4ef1-be70-0b8a9c8858a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.500749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035581-1b1a-4ef1-be70-0b8a9c8858a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.502169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035581-1b1a-4ef1-be70-0b8a9c8858a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.507372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035581-1b1a-4ef1-be70-0b8a9c8858a4 admin admin] PATH_INFO: `/v3/projects/505a6d7fd95541bdbfa66b73605a08d8/users/966cb526d8364ff99f095641fb31eefd/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.526141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495432-2a03-4e52-9cbf-b32e891d1236 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.544238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035581-1b1a-4ef1-be70-0b8a9c8858a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=505a6d7fd95541bdbfa66b73605a08d8, user_id=966cb526d8364ff99f095641fb31eefd, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.545792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.548012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.548371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035581-1b1a-4ef1-be70-0b8a9c8858a4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.548546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.549044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.550464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.554503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.571393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1081/2136] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:24 2022] PUT /identity/v3/projects/505a6d7fd95541bdbfa66b73605a08d8/users/966cb526d8364ff99f095641fb31eefd/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:24.572984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.573353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.573646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.607473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:24.610523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:24.626076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1056/2137] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:24 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:24.627341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.687739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:24.780628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:24.884576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1082/2138] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:24.891768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.913779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afd8e6-eb78-4f81-828d-5c181c13bed1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.925379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da65f3-87f8-4b4f-956c-10bb23754f9b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:24.926864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.928009 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.928880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.929022 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.930542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.933826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.944309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:24.945417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:24.945876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:24.946369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:24.947566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:24.954987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:24.957043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1057/2139] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:24.958674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:24.972156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.006759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59d3b7-8e1a-43d8-9fc6-179930ef7ed2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:25.019668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:25.022780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:25.023378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:25.024203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] PATH_INFO: `/v3/projects/b5cdf3741b304ad097c79641683c0382` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:25.027470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cdf3741b304ad097c79641683c0382)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:25.032058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:25.037103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1083/2140] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:24 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:25.047389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:25.054859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.219857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a571a-6e2c-40f5-abc9-4eae4535d250 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:25.242071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cdf3741b304ad097c79641683c0382', 'request_id': 'req-575880b3-585a-4e85-b0ab-63be3a3bcac2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:25.256438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cdf3741b304ad097c79641683c0382', 'request_id': 'req-575880b3-585a-4e85-b0ab-63be3a3bcac2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:25.332801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cdf3741b304ad097c79641683c0382', 'request_id': 'req-575880b3-585a-4e85-b0ab-63be3a3bcac2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:25.372490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] The token cache is being invalidate because project b5cdf3741b304ad097c79641683c0382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:25.372786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:25.373820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:25.376371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1058/2141] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:24 2022] DELETE /identity/v3/projects/b5cdf3741b304ad097c79641683c0382 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:25.380383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:25.382520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.386159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:25.387300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:25.387738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:25.388217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:25.390821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.498738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:25.501191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:25.522795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1084/2142] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:25.523773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:25.530970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.533046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575880b3-585a-4e85-b0ab-63be3a3bcac2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:25.540452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:25.541756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:25.542057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:25.542327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] PATH_INFO: `/v3/projects/505a6d7fd95541bdbfa66b73605a08d8/users/966cb526d8364ff99f095641fb31eefd/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:25.544725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=505a6d7fd95541bdbfa66b73605a08d8, user_id=966cb526d8364ff99f095641fb31eefd, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:25.547131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb079665-46a2-4815-a42f-12a97765a662 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:25.548276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:25.566934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1059/2143] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:25 2022] PUT /identity/v3/projects/505a6d7fd95541bdbfa66b73605a08d8/users/966cb526d8364ff99f095641fb31eefd/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:25.568030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:25.570702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.585406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80cb69-5765-4cdd-bd85-262678d723a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:25.586488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80cb69-5765-4cdd-bd85-262678d723a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:25.586973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80cb69-5765-4cdd-bd85-262678d723a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:25.587911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80cb69-5765-4cdd-bd85-262678d723a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:25.590738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80cb69-5765-4cdd-bd85-262678d723a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:25.595514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80cb69-5765-4cdd-bd85-262678d723a9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:25.625052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1085/2144] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:25.628477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:25.629038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:25.629558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:25.659653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:25.718054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] MFA Rules not processed for user `966cb526d8364ff99f095641fb31eefd`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:25.720477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:25.771966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:25.854908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60f8a8-9247-494f-8350-df04019dbe14 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:25.872922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:25.874544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:25.875030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:25.875511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] PATH_INFO: `/v3/users/a430f7d12ea44788b454e24a47d3f21d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:25.882247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a430f7d12ea44788b454e24a47d3f21d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:25.886755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:25.959932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1086/2145] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:25.961158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:25.989494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8556fec-2d4c-4e53-9e8f-15e7a9f39664 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:26.002275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:26.004286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:26.004286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:26.007005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:26.013274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:26.018286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:26.048075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1087/2146] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:26.048075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:26.052242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:26.093726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a430f7d12ea44788b454e24a47d3f21d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:26.123198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a430f7d12ea44788b454e24a47d3f21d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:26.156157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a430f7d12ea44788b454e24a47d3f21d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:26.156975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a430f7d12ea44788b454e24a47d3f21d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:26.178292 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a430f7d12ea44788b454e24a47d3f21d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:26.192756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1060/2147] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:25 2022] DELETE /identity/v3/users/a430f7d12ea44788b454e24a47d3f21d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:26.193805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:26.204764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:26.329936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6756-ea39-47b6-94ab-975aa00625b9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:26.405185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf094f-0092-4ce0-ba97-1fc4fb58ca52 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:26.422682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304910-307f-43f3-9568-fd551f032208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:26.425190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304910-307f-43f3-9568-fd551f032208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:26.425919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304910-307f-43f3-9568-fd551f032208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:26.426736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304910-307f-43f3-9568-fd551f032208 admin admin] PATH_INFO: `/v3/projects/ad0af89c24ea4ea98b497659a5a5c9c0/users/846fb2a4fe1e4d05825724caaab2daa9/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:26.485885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304910-307f-43f3-9568-fd551f032208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0af89c24ea4ea98b497659a5a5c9c0, user_id=846fb2a4fe1e4d05825724caaab2daa9, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:26.492394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304910-307f-43f3-9568-fd551f032208 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:26.546561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1061/2148] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:26 2022] PUT /identity/v3/projects/ad0af89c24ea4ea98b497659a5a5c9c0/users/846fb2a4fe1e4d05825724caaab2daa9/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:26.570986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:26.571512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:26.579563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:26.600951 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:26.606843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:26.607588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:26.608069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:26.614560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:26.712307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] MFA Rules not processed for user `846fb2a4fe1e4d05825724caaab2daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:26.714596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:26.849001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:26.849224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:26.895421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:26.899377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a781bfc-9968-45f0-9057-581e4fff6379 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:26.923931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1088/2149] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:26.926921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:26.929160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:26.929580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:26.993889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1062/2150] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:27.001066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:27.003287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:27.041435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] MFA Rules not processed for user `144457df5bd2420796f8f8d6bbce7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:27.044463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:27.224632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1089/2151] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:27.224632 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:27.226237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c2dd5-7611-44cd-846c-08944e4ca6cf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:27.242333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:27.244172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.244850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebcaa5-f22d-4f2f-aabb-ebb1ecd093da None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:27.246165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.246998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] PATH_INFO: `/v3/projects/4756e8c0fadb4935a81509f0c11328f1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.249864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4756e8c0fadb4935a81509f0c11328f1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:27.251744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:27.252436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.252719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.252996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.253717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:27.254797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:27.255759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:27.316691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1090/2152] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:27.317202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:27.324917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:27.407361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4756e8c0fadb4935a81509f0c11328f1', 'request_id': 'req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.424734 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4756e8c0fadb4935a81509f0c11328f1', 'request_id': 'req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.441908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4756e8c0fadb4935a81509f0c11328f1', 'request_id': 'req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.447625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbe805-bb7e-4d01-9c64-38ea5fbd314b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:27.468608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] The token cache is being invalidate because project 4756e8c0fadb4935a81509f0c11328f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:27.469400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.478483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.486068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1063/2153] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:26 2022] DELETE /identity/v3/projects/4756e8c0fadb4935a81509f0c11328f1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:27.486068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:27.492875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:27.596988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:27.599771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.600300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.600802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] PATH_INFO: `/v3/projects/0b9d2e73f95a4a6599be6e16d0299228` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.603918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9d2e73f95a4a6599be6e16d0299228)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:27.608774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:27.614736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:27.623115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:27.634652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0c9a-ee69-46ad-96f0-5c92107232a4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:27.649609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:27.651714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.652254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.652764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.657001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:27.708115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9d2e73f95a4a6599be6e16d0299228', 'request_id': 'req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.718034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9d2e73f95a4a6599be6e16d0299228', 'request_id': 'req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.740059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9d2e73f95a4a6599be6e16d0299228', 'request_id': 'req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.782200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] The token cache is being invalidate because project 0b9d2e73f95a4a6599be6e16d0299228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:27.782640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.783667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:27.788509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1091/2154] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:27 2022] DELETE /identity/v3/projects/0b9d2e73f95a4a6599be6e16d0299228 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:27.788890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:27.793174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:27.879826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:27.883463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a18852-89b7-422a-a2e8-6ae226548911 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:27.919222 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1064/2155] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:27.921767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.924931 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a8dd6-deb7-4a97-a070-cd1fd37d594c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:27.931369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.932190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.939907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad0a3-cea1-4719-858f-22d8db0da549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:27.941183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad0a3-cea1-4719-858f-22d8db0da549 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.941587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad0a3-cea1-4719-858f-22d8db0da549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.941991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad0a3-cea1-4719-858f-22d8db0da549 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.943474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad0a3-cea1-4719-858f-22d8db0da549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:27.946551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad0a3-cea1-4719-858f-22d8db0da549 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:27.984698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1092/2156] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:27 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:27.988959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:27.990195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:27.990728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:27.991828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] MFA Rules not processed for user `71d99aa30493428897ca7c8c2909a4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:27.994106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:28.042963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:28.046065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:28.068486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1093/2157] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:28.070755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.075780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:28.094711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27397-2035-46dd-9be6-0a26b741bd01 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.103044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:28.105223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.105641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.106254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] PATH_INFO: `/v3/users/7dae03992fe14858afdeef81a604333b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:28.109092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dae03992fe14858afdeef81a604333b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:28.115035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:28.236066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1065/2158] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:28.239466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.265041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dae03992fe14858afdeef81a604333b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:28.270353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dae03992fe14858afdeef81a604333b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:28.276781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42246f-91f8-4c1f-b112-675849815dcf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.285473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9611a2-40e6-4b99-88eb-99c29e83d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:28.291351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9611a2-40e6-4b99-88eb-99c29e83d128 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.291868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9611a2-40e6-4b99-88eb-99c29e83d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.292908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9611a2-40e6-4b99-88eb-99c29e83d128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:28.293762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9611a2-40e6-4b99-88eb-99c29e83d128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:28.298039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9611a2-40e6-4b99-88eb-99c29e83d128 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:28.299661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dae03992fe14858afdeef81a604333b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:28.327855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1066/2159] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:28.330467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.330921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.331384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:28.353383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dae03992fe14858afdeef81a604333b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:28.372470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:28.393004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:28.395656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:28.397889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dae03992fe14858afdeef81a604333b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:28.414952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1094/2160] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:28 2022] DELETE /identity/v3/users/7dae03992fe14858afdeef81a604333b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:28.416334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.423491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1067/2161] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:28.424496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:28.424997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.456849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a3ca-d325-4239-920a-a04ae13f2800 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.617576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:28.618345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.618604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.618874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:28.619683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:28.619992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:28.621767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:28.641724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1068/2162] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:28.642850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.655057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72571-a7cd-4bc1-b4ba-f05cee8f3c05 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.660664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:28.661467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.661817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.662321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:28.663101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:28.665148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:28.685284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1706f-1b53-45a2-90d8-8036cb1a8201 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.695452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:28.699152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:28.700935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.702114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.702738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] PATH_INFO: `/v3/projects/2676a204469f4cb4b5f4ceb3940c3b4f/users/7ccf5a5b6a984805b54cb78334ac1cbe/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:28.712358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1069/2163] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:28.713593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.760902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2676a204469f4cb4b5f4ceb3940c3b4f, user_id=7ccf5a5b6a984805b54cb78334ac1cbe, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:28.768307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:28.807447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1095/2164] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:28 2022] PUT /identity/v3/projects/2676a204469f4cb4b5f4ceb3940c3b4f/users/7ccf5a5b6a984805b54cb78334ac1cbe/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:28.828896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:28.890318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4bcd8-784a-4945-87bd-050cb02ff0be admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.990781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9316a-0c1a-4fad-a36d-4d33e6f72fba admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:28.996790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:28.997714 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:28.997894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:28.998764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.000496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.002327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.017778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1096/2165] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:29.019060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.031972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dbc2d-3d3f-4538-873b-6d5b6607e3d3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.050675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfca94-510a-4c02-bf48-a919dee028e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.051763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfca94-510a-4c02-bf48-a919dee028e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.052301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfca94-510a-4c02-bf48-a919dee028e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.052626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfca94-510a-4c02-bf48-a919dee028e4 admin admin] PATH_INFO: `/v3/projects/2676a204469f4cb4b5f4ceb3940c3b4f/users/7ccf5a5b6a984805b54cb78334ac1cbe/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.056376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfca94-510a-4c02-bf48-a919dee028e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2676a204469f4cb4b5f4ceb3940c3b4f, user_id=7ccf5a5b6a984805b54cb78334ac1cbe, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.059561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfca94-510a-4c02-bf48-a919dee028e4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.063887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.065473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.065994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.066573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.067580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.069751 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.093485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1097/2166] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:29 2022] PUT /identity/v3/projects/2676a204469f4cb4b5f4ceb3940c3b4f/users/7ccf5a5b6a984805b54cb78334ac1cbe/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:29.095939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.096392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.096808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.112468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1070/2167] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:28 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:29.122808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.142017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980449a-8bc6-4e81-bbbe-dc3dff9ccdcd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.165271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] MFA Rules not processed for user `7ccf5a5b6a984805b54cb78334ac1cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:29.169216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:29.244559 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:29.303599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1098/2168] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:29.303599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.305240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:29.315347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.315994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.315994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.317323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.318738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.324163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.353159 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1071/2169] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:29.356951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.359578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:29.413048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a022a7-761c-4815-af83-afeb55d0551a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.420768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.421933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.422455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.422921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.425778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:29.491438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:29.556444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5b465-64d9-472e-a92f-591dfedd50a4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.564323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.565801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.566429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.567063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.587405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.588456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.589279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.593526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.601193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1099/2170] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:29.602266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.615303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494335-e528-4b59-b73f-2d73db6c6caa service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.621914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.622750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.623175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.623715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.624590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.626681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.639805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1100/2171] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:29.640873 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.647368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1072/2172] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:29.648264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:29.649162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:29.662646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7969-d721-474a-8a2f-6a92e1d77374 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.668035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f5dc0-88b6-4f6e-8e72-4049011ec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.669249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5dc0-88b6-4f6e-8e72-4049011ec37f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.669639 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5dc0-88b6-4f6e-8e72-4049011ec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.670399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f5dc0-88b6-4f6e-8e72-4049011ec37f admin admin] PATH_INFO: `/v3/projects/588bd87725714ecfb7812a1009189487/users/ea1f159c154b42988ef9cb9bab9bda48/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.681270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba345b8-7d8a-46e6-b57e-0b062ecc6103 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:29.687675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:29.688580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.689043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.689289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] PATH_INFO: `/v3/projects/e4d7b4312d604d54aaad359da62210b3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.691758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d7b4312d604d54aaad359da62210b3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.696811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.727500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f5dc0-88b6-4f6e-8e72-4049011ec37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=588bd87725714ecfb7812a1009189487, user_id=ea1f159c154b42988ef9cb9bab9bda48, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:29.734824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f5dc0-88b6-4f6e-8e72-4049011ec37f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:29.782683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1073/2173] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:29 2022] PUT /identity/v3/projects/588bd87725714ecfb7812a1009189487/users/ea1f159c154b42988ef9cb9bab9bda48/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:29.784344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.784702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.785045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.800334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d7b4312d604d54aaad359da62210b3', 'request_id': 'req-e719dc01-744f-4208-b97e-0070ed868ddb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:29.821359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d7b4312d604d54aaad359da62210b3', 'request_id': 'req-e719dc01-744f-4208-b97e-0070ed868ddb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:29.841186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d7b4312d604d54aaad359da62210b3', 'request_id': 'req-e719dc01-744f-4208-b97e-0070ed868ddb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:29.856299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] MFA Rules not processed for user `ea1f159c154b42988ef9cb9bab9bda48`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:29.858128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:29.898474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] The token cache is being invalidate because project e4d7b4312d604d54aaad359da62210b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:29.898973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:29.906735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e719dc01-744f-4208-b97e-0070ed868ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:29.919332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1101/2174] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:29 2022] DELETE /identity/v3/projects/e4d7b4312d604d54aaad359da62210b3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:29.926083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08b0c-8462-422f-a96e-159cfbb8fed5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:29.926406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08b0c-8462-422f-a96e-159cfbb8fed5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:29.926894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d08b0c-8462-422f-a96e-159cfbb8fed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:29.981046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:30.032790 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1074/2175] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:30.038725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-65d08b0c-8462-422f-a96e-159cfbb8fed5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:30.040773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65d08b0c-8462-422f-a96e-159cfbb8fed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:30.102670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:30.104534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:30.270217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4db6ea-57c8-407c-89f6-e59319a69d78 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:30.270499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1102/2176] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:30.271880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:30.271880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:30.272378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:30.272378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:30.275170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:30.275447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:30.275720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:30.290401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:30.291899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:30.318354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1075/2177] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:30.319032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:30.320657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:30.334013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1103/2178] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:30.337949 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:30.353042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594435a-75c4-4c5b-aef2-ae9cc21529e0 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:30.370129 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:30.371211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:30.371727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:30.372109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:30.389589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:30.390107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:30.392347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:30.433797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:30.435100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1076/2179] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:25:30.455241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d027fb-4065-46c3-9240-be1cb5e43837 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:30.477697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:30.479758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:30.480800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:30.481090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:30.485671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:30.496988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:30.567436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:30.578241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1104/2180] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:30 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:30.586353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0189-2a6e-401d-be2b-38b00ef33175 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:30.736929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:30.908090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:30.909641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:30.910302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:30.910932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:30.912416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:30.917101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:30.975340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1077/2181] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:30 2022] POST /identity/v3/users => generated 292 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:30.985093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:31.002239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122b18-bd69-4be5-b585-035416b81d88 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:31.016650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:31.019926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:31.020370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:31.020824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:31.023275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:31.027258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:31.058825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:31.060072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1105/2182] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:31.082604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b98d1-f3f5-4333-afaa-e5fb980ab2da admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:31.105182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f786-4346-453e-9ee0-6d4ddd47378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:31.119625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f786-4346-453e-9ee0-6d4ddd47378e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:31.121100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f786-4346-453e-9ee0-6d4ddd47378e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:31.123716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f786-4346-453e-9ee0-6d4ddd47378e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:31.127250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f786-4346-453e-9ee0-6d4ddd47378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:31.132467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651f786-4346-453e-9ee0-6d4ddd47378e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:31.205448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:31.209524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1078/2183] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:31.242655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df114-c15a-44e7-820c-d6aa8d61abdc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:31.268066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:31.269104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:31.272786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:31.273670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] PATH_INFO: `/v3/projects/09a70197e6d24abca5c8e2f9d8eb7ed9/users/98d8ad21722c482682e5108e6bf8779e/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:31.349079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a70197e6d24abca5c8e2f9d8eb7ed9, user_id=98d8ad21722c482682e5108e6bf8779e, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:31.357797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:31.412459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1106/2184] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:31 2022] PUT /identity/v3/projects/09a70197e6d24abca5c8e2f9d8eb7ed9/users/98d8ad21722c482682e5108e6bf8779e/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:31.428757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:31.429263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:31.431422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:31.530504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] MFA Rules not processed for user `98d8ad21722c482682e5108e6bf8779e`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:31.532302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:31.679220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:31.681093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:31.720478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1079/2185] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:31.725364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:31.890260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad81d-d317-407c-ad33-5103d1359c3b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:31.908166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:31.908982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:31.909329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:31.909748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:31.910557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:31.912600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:31.917163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e509-c226-4713-8b36-38fbeb04b0c2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:31.926654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:31.928196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:31.929764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:31.930655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:31.937472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:31.981918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1080/2186] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:31 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:31.983519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:32.051051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:32.181766 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc716f-b0d1-4065-91ba-71adcd8efba6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:32.224432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:32.225654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.226179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.226668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.228011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.234597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:32.240096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.274982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.285402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.330741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1107/2187] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:32.339535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1081/2188] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:31 2022] POST /identity/v3/users => generated 298 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:32.344274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:32.384657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7980-f906-43b3-b040-e221b11b9c34 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:32.398546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:32.400294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.402332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.402753 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.404902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.409086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.427376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1108/2189] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:32.433996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:32.465862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823bc4e-c83a-4ec3-ac7d-a3dfd65284b3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:32.507197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18a66-7669-4ea0-bbce-c7ab05add810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:32.508900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18a66-7669-4ea0-bbce-c7ab05add810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.509692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18a66-7669-4ea0-bbce-c7ab05add810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.510387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18a66-7669-4ea0-bbce-c7ab05add810 admin admin] PATH_INFO: `/v3/projects/a098c3fa780a43f5b02525308fc985c5/users/ed626c56f8b04ce8935bdaadbbb2809d/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.575794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18a66-7669-4ea0-bbce-c7ab05add810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a098c3fa780a43f5b02525308fc985c5, user_id=ed626c56f8b04ce8935bdaadbbb2809d, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.592844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18a66-7669-4ea0-bbce-c7ab05add810 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.653134 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1082/2190] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:32 2022] PUT /identity/v3/projects/a098c3fa780a43f5b02525308fc985c5/users/ed626c56f8b04ce8935bdaadbbb2809d/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:32.655930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:32.667730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.668228 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.668717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.687942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493f0d-95d7-4d36-a3ad-48eb0eb7463f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:32.703455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] MFA Rules not processed for user `144457df5bd2420796f8f8d6bbce7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:32.706904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:32.810040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:32.812697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.813338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.813842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.815256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.817503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.841356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1109/2191] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:32.843624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:32.846368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:32.864579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596b18-16a3-4427-a071-ea979ad8d6b1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:32.870430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1083/2192] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:32.873877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:32.875005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:32.876029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.876316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.876590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] PATH_INFO: `/v3/users/846fb2a4fe1e4d05825724caaab2daa9` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.878693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=846fb2a4fe1e4d05825724caaab2daa9)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.882862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.906168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5ad07-0274-4ae5-94cd-e3165c0d4a8e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:32.923636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8196e-c172-4ac4-8865-cd611d7b059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:32.924732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8196e-c172-4ac4-8865-cd611d7b059a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.925011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8196e-c172-4ac4-8865-cd611d7b059a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.925371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8196e-c172-4ac4-8865-cd611d7b059a admin admin] PATH_INFO: `/v3/projects/a098c3fa780a43f5b02525308fc985c5/users/ed626c56f8b04ce8935bdaadbbb2809d/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:32.932484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8196e-c172-4ac4-8865-cd611d7b059a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a098c3fa780a43f5b02525308fc985c5, user_id=ed626c56f8b04ce8935bdaadbbb2809d, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:32.942969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8196e-c172-4ac4-8865-cd611d7b059a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:32.970804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1084/2193] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:32 2022] PUT /identity/v3/projects/a098c3fa780a43f5b02525308fc985c5/users/ed626c56f8b04ce8935bdaadbbb2809d/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:32.991291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:32.991760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:32.992275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:33.000382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846fb2a4fe1e4d05825724caaab2daa9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:33.004867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846fb2a4fe1e4d05825724caaab2daa9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:33.049135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846fb2a4fe1e4d05825724caaab2daa9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:33.059082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] MFA Rules not processed for user `ed626c56f8b04ce8935bdaadbbb2809d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:33.063759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:33.075422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846fb2a4fe1e4d05825724caaab2daa9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:33.116817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11f94aa2-7829-45ff-8684-3428f7eb14bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846fb2a4fe1e4d05825724caaab2daa9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:33.143227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1110/2194] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:32 2022] DELETE /identity/v3/users/846fb2a4fe1e4d05825724caaab2daa9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:33.151556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:33.152212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:33.153082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:33.191872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:33.194468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:33.267633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1085/2195] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:33.288541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:33.290988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:33.314223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:33.347374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:33.415042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1111/2196] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:33.445950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:33.449530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:33.498892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18934a-e2a9-4085-893e-51e0f5daf6b8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:33.687122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd7b31-2084-48f5-b397-5906e8161a73 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:33.700451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:33.702362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:33.702866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:33.703341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:33.718616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:33.720085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:33.724258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:33.725590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:33.733888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:33.734352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:33.741851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:33.796290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1112/2197] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:33.909092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:33.910901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cab483-cf3f-4f5c-949a-615ea68c37e8 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:33.956395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1086/2198] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:34.296104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:34.299020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:34.359144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1760473-e56c-41bb-9619-e870604b3a90 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:34.409636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:34.415800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:34.416452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:34.418154 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] PATH_INFO: `/v3/users/ea1f159c154b42988ef9cb9bab9bda48` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:34.419834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1f159c154b42988ef9cb9bab9bda48)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:34.421876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:34.515560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1f159c154b42988ef9cb9bab9bda48'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:34.517864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1f159c154b42988ef9cb9bab9bda48'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:34.542183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1f159c154b42988ef9cb9bab9bda48'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:34.572010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1f159c154b42988ef9cb9bab9bda48'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:34.619940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1f159c154b42988ef9cb9bab9bda48'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:34.645585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1113/2199] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:34 2022] DELETE /identity/v3/users/ea1f159c154b42988ef9cb9bab9bda48 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:34.650553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:34.650995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:34.651164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:34.862609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:34.865626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:34.969112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:35.070938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:35.073393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:35.138939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1087/2200] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:35.179160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:35.180944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:35.279796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:35.344448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fa13-cda9-44da-ad00-6f59e87f8e7b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:35.351988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:35.354078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:35.354347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:35.354814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] PATH_INFO: `/v3/projects/ad0af89c24ea4ea98b497659a5a5c9c0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:35.356146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0af89c24ea4ea98b497659a5a5c9c0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:35.358807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:35.433803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128e600-08f4-4001-ac4c-cb16c75dbd9b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:35.451627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0af89c24ea4ea98b497659a5a5c9c0', 'request_id': 'req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.465427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0af89c24ea4ea98b497659a5a5c9c0', 'request_id': 'req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.502117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0af89c24ea4ea98b497659a5a5c9c0', 'request_id': 'req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.542279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:35.543500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:35.543880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:35.544259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:35.557776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] The token cache is being invalidate because project ad0af89c24ea4ea98b497659a5a5c9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:35.558587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.559906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.568587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1114/2201] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:35 2022] DELETE /identity/v3/projects/ad0af89c24ea4ea98b497659a5a5c9c0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:35.569899 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:35.574807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:35.649436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:35.713758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:35.718174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:35.739773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1088/2202] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:35.745455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e7f3-5d1a-413d-a7c7-2cb0c74f4460 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:35.757358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:35.759467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:35.759788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:35.760292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] PATH_INFO: `/v3/users/7ccf5a5b6a984805b54cb78334ac1cbe` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:35.763075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ccf5a5b6a984805b54cb78334ac1cbe)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:35.767959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:35.916869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ccf5a5b6a984805b54cb78334ac1cbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.919350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ccf5a5b6a984805b54cb78334ac1cbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.946211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ccf5a5b6a984805b54cb78334ac1cbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.995924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ccf5a5b6a984805b54cb78334ac1cbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:35.999338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:36.060988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ccf5a5b6a984805b54cb78334ac1cbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:36.079758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1115/2203] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:35 2022] DELETE /identity/v3/users/7ccf5a5b6a984805b54cb78334ac1cbe => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:36.496283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:36.505505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:36.542065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4e83-8560-45ef-af15-fc45821b5d5a service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:36.834330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:36.838386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:36.839183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:36.839888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] PATH_INFO: `/v3/projects/588bd87725714ecfb7812a1009189487` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:36.843167 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] RBAC: Authorizing `identity:delete_project(project_id=588bd87725714ecfb7812a1009189487)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:36.847402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:36.993872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588bd87725714ecfb7812a1009189487', 'request_id': 'req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.021792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588bd87725714ecfb7812a1009189487', 'request_id': 'req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.063883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588bd87725714ecfb7812a1009189487', 'request_id': 'req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.105093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] The token cache is being invalidate because project 588bd87725714ecfb7812a1009189487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:37.106109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.109412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-216c2f68-923b-4a5a-9f4d-bdbf9c60223c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.114795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1089/2204] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:36 2022] DELETE /identity/v3/projects/588bd87725714ecfb7812a1009189487 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:37.505927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:37.507712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:37.548503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f61e0-e9c3-45d2-bba8-3be859d2e690 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:37.665887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:37.667771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:37.668241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:37.668675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] PATH_INFO: `/v3/projects/2676a204469f4cb4b5f4ceb3940c3b4f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:37.670857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2676a204469f4cb4b5f4ceb3940c3b4f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:37.672813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:37.776237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2676a204469f4cb4b5f4ceb3940c3b4f', 'request_id': 'req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.788209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2676a204469f4cb4b5f4ceb3940c3b4f', 'request_id': 'req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.798874 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2676a204469f4cb4b5f4ceb3940c3b4f', 'request_id': 'req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.819956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] The token cache is being invalidate because project 2676a204469f4cb4b5f4ceb3940c3b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:37.820457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.821495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1be7af55-e9c8-4b4e-a4df-3de3f77a88d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:37.824208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1116/2205] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:37 2022] DELETE /identity/v3/projects/2676a204469f4cb4b5f4ceb3940c3b4f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:37.831613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:37.831963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:37.832191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:37.879557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:37.880843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:37.950543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:37.968100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1090/2206] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:37.986347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:37.986849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:37.987359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.024332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:38.026433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:38.043927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1117/2207] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:38.052666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.069038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6e32-59a9-47ae-a171-ef6681abd712 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.075865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.076775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.077161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.077525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.079172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:38.080588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.083176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.099849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1091/2208] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:38.105070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.116313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0251-01d6-4140-8e5e-947eafb02e79 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.124297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.125350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.125783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.126388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.127466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.131246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.177127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1118/2209] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:38.182926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.195220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceeaff-9593-4bfc-b6d1-c87c4e153af3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.318619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.319330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.319623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.319955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.320802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.323411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.359305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1092/2210] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:38 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:38.360890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.366414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.378721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27577-8576-4f74-82ad-516fcf9d8de6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.385894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:38.394960 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.396624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.397553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.398228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.400260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.405054 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.407345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06380b39-9a3e-43bb-a0ae-0f86e0bae3ad admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.412993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.413898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.414218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.414503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] PATH_INFO: `/v3/users/f220c486bf9c42e7a41eef7a6c40b22f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.415968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f220c486bf9c42e7a41eef7a6c40b22f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.418508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.432827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1119/2211] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:38.439515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.465053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a9cf-d4fa-41b1-b655-15d82a5c594b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.476725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.478290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.479017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.479988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.482609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.488274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.503635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f220c486bf9c42e7a41eef7a6c40b22f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:38.521668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f220c486bf9c42e7a41eef7a6c40b22f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:38.523613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1120/2212] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:38.526687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.534252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f220c486bf9c42e7a41eef7a6c40b22f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:38.535388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f220c486bf9c42e7a41eef7a6c40b22f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:38.547589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa08522-3595-4d16-bdba-e4950612c82e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:38.556181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05550855-4991-4d32-8f49-e2a6d876200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:38.557698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05550855-4991-4d32-8f49-e2a6d876200c admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.562592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a02550a1-c155-4e41-acf2-4a8ac2437f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f220c486bf9c42e7a41eef7a6c40b22f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:38.565046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05550855-4991-4d32-8f49-e2a6d876200c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.565706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05550855-4991-4d32-8f49-e2a6d876200c admin admin] PATH_INFO: `/v3/projects/9715109f43254ed68d1b936f0bde08c4/users/467a1d5404694cb99391bac7183df993/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.579778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1093/2213] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:38 2022] DELETE /identity/v3/users/f220c486bf9c42e7a41eef7a6c40b22f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:38.587109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.589453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.589942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.611544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05550855-4991-4d32-8f49-e2a6d876200c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9715109f43254ed68d1b936f0bde08c4, user_id=467a1d5404694cb99391bac7183df993, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:38.625670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05550855-4991-4d32-8f49-e2a6d876200c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:38.627520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:38.632194 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:38.632762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:38.667146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1121/2214] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:38 2022] PUT /identity/v3/projects/9715109f43254ed68d1b936f0bde08c4/users/467a1d5404694cb99391bac7183df993/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:38.692253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:38.692746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:38.693270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:38.739870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:38.759751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] MFA Rules not processed for user `467a1d5404694cb99391bac7183df993`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:38.772466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:38.830724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1094/2215] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:38.840051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:38.842850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:39.022150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1122/2216] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:39.037907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:39.041143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:39.044584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8965c56-7c57-494d-8266-a81be17885d6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:39.191545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10d0fb-9654-4508-a0e6-02ce7837c1f1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:39.198570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:39.199406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:39.200717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:39.201051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:39.201552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:39.202108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:39.202588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:39.203057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:39.224363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:39.226485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:39.254028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1123/2217] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:39.355437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:39.357353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:39.370800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1095/2218] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:39.851916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:39.854325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:39.877264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a534-ceb6-4b3b-a99e-5b4d06271daa service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:39.884393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:39.885852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:39.886199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:39.886566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] PATH_INFO: `/v3/projects/c6e52fac92f84cc48afc970edf306986` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:39.888215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e52fac92f84cc48afc970edf306986)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:39.891116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:39.951017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e52fac92f84cc48afc970edf306986', 'request_id': 'req-19012a58-7edf-41ee-8251-6b0a37193c95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:39.958834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e52fac92f84cc48afc970edf306986', 'request_id': 'req-19012a58-7edf-41ee-8251-6b0a37193c95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:39.967489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e52fac92f84cc48afc970edf306986', 'request_id': 'req-19012a58-7edf-41ee-8251-6b0a37193c95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:39.982734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] The token cache is being invalidate because project c6e52fac92f84cc48afc970edf306986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:39.983035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:39.983744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:39.985350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1124/2219] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:39 2022] DELETE /identity/v3/projects/c6e52fac92f84cc48afc970edf306986 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:39.989841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:40.001875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096276-674e-4f05-8705-0115ec946b40 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:40.075398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:40.116020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:40.123258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:40.123999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:40.124583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] PATH_INFO: `/v3/users/23466ecd5849469aa1fb99bf93968f7e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:40.126958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23466ecd5849469aa1fb99bf93968f7e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:40.132682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:40.232650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23466ecd5849469aa1fb99bf93968f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:40.262482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23466ecd5849469aa1fb99bf93968f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:40.298960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23466ecd5849469aa1fb99bf93968f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:40.299649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23466ecd5849469aa1fb99bf93968f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:40.317362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23466ecd5849469aa1fb99bf93968f7e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:40.345424 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1096/2220] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:39 2022] DELETE /identity/v3/users/23466ecd5849469aa1fb99bf93968f7e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:40.408467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:40.411533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:40.447058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:40.569408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19012a58-7edf-41ee-8251-6b0a37193c95 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:40.670795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:40.671484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:40.671767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:40.672048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:40.674282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:40.788052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:40.789947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:40.830800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1125/2221] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:41.000466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:41.002769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:41.194283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5565f2-d7e6-486a-b06d-304752424625 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:41.205649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:41.207423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:41.208118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:41.208575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] PATH_INFO: `/v3/projects/b73dd990a6cb42a59b9c60b273d32569` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:41.210621 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73dd990a6cb42a59b9c60b273d32569)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:41.215001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:41.373738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73dd990a6cb42a59b9c60b273d32569', 'request_id': 'req-2e302ed5-c207-4d62-918a-0926f96873fd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.396101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73dd990a6cb42a59b9c60b273d32569', 'request_id': 'req-2e302ed5-c207-4d62-918a-0926f96873fd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.427759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73dd990a6cb42a59b9c60b273d32569', 'request_id': 'req-2e302ed5-c207-4d62-918a-0926f96873fd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.460976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:41.480638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] The token cache is being invalidate because project b73dd990a6cb42a59b9c60b273d32569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:41.484323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.485543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.496750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1097/2222] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:40 2022] DELETE /identity/v3/projects/b73dd990a6cb42a59b9c60b273d32569 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:41.500653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:41.541474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d537e6-5d7d-44c8-8a28-240e0ca69deb service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:41.830887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:41.832147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:41.832589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:41.833047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] PATH_INFO: `/v3/users/966cb526d8364ff99f095641fb31eefd` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:41.835932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966cb526d8364ff99f095641fb31eefd)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:41.838218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:41.865599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:41.921890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966cb526d8364ff99f095641fb31eefd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.924157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966cb526d8364ff99f095641fb31eefd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.934414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966cb526d8364ff99f095641fb31eefd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:41.948391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966cb526d8364ff99f095641fb31eefd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:42.031437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11d50c0e-a51f-4a76-adb2-c54d034d8412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966cb526d8364ff99f095641fb31eefd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:42.050605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1126/2223] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:41 2022] DELETE /identity/v3/users/966cb526d8364ff99f095641fb31eefd => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:42.854211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:42.857526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:42.885459 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e302ed5-c207-4d62-918a-0926f96873fd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.033097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.037685 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.040169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.040773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] PATH_INFO: `/v3/projects/505a6d7fd95541bdbfa66b73605a08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.048021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] RBAC: Authorizing `identity:delete_project(project_id=505a6d7fd95541bdbfa66b73605a08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.055857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.147839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505a6d7fd95541bdbfa66b73605a08d8', 'request_id': 'req-7ef433a3-5f7c-45e9-877a-520a0576303d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:43.156453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505a6d7fd95541bdbfa66b73605a08d8', 'request_id': 'req-7ef433a3-5f7c-45e9-877a-520a0576303d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:43.165169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505a6d7fd95541bdbfa66b73605a08d8', 'request_id': 'req-7ef433a3-5f7c-45e9-877a-520a0576303d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:43.183354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] The token cache is being invalidate because project 505a6d7fd95541bdbfa66b73605a08d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:43.184087 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:43.185553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7ef433a3-5f7c-45e9-877a-520a0576303d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:43.188373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1098/2224] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:42 2022] DELETE /identity/v3/projects/505a6d7fd95541bdbfa66b73605a08d8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:43.197786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.198344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.198729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.231288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:43.233707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:43.372342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1127/2225] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:43.382687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0554d-c430-4507-862d-60b46915770e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.383111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0554d-c430-4507-862d-60b46915770e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.383549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0554d-c430-4507-862d-60b46915770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.423005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a0c0554d-c430-4507-862d-60b46915770e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:43.424584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a0c0554d-c430-4507-862d-60b46915770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:43.435610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1099/2226] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:43.440069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:43.459998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244698a-9c27-4efb-9bff-f4c9ed745368 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.468012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.468762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.469020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.470459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.471975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:43.472587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.476027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.499493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1128/2227] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:43.503896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0554d-c430-4507-862d-60b46915770e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:43.516454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0554d-c430-4507-862d-60b46915770e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.522103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.522924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.523365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.524044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.524515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.526577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.558683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1100/2228] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:43 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:43.563239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:43.575855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6c633-9d0c-42c8-bdc5-ef40517fa11c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.658045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.659139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.659519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.659965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.661026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.663450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.706036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1129/2229] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:43 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:43.712433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:43.729850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce822970-b0ee-442b-b2ec-aa2abff8c4a1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.735490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.736187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.736471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.736865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.737613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.739323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.757903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1101/2230] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:43.761792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:43.773927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996bd55-85ee-4855-aa96-49079e0401a4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.785030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424d23-3696-4876-b6f2-a4171c46c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.785912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424d23-3696-4876-b6f2-a4171c46c7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.786248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424d23-3696-4876-b6f2-a4171c46c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.786392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424d23-3696-4876-b6f2-a4171c46c7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.787320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424d23-3696-4876-b6f2-a4171c46c7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.788938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424d23-3696-4876-b6f2-a4171c46c7f8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.807214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:43.812812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1130/2231] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:25:43.818980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33f80-3e8d-48cc-9442-a97ed6967f05 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:43.827215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:43.829075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.829578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.830405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] PATH_INFO: `/v3/projects/6cf029b3aba44ef4a4793baf09fa7eca/users/ad772551f01343568677b4cff1cbaa1f/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.856232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf029b3aba44ef4a4793baf09fa7eca, user_id=ad772551f01343568677b4cff1cbaa1f, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:43.860359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:43.876657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1102/2232] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:43 2022] PUT /identity/v3/projects/6cf029b3aba44ef4a4793baf09fa7eca/users/ad772551f01343568677b4cff1cbaa1f/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:43.887443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:43.888476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:43.888842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:43.896221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:43.927411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] MFA Rules not processed for user `ad772551f01343568677b4cff1cbaa1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:43.928734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:44.027572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1131/2233] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:44.044212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:44.049055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:44.134064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:44.262882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4588dc-0b54-4495-9ef7-9d8480562808 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:44.269803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385e124-cfbf-4acb-b15b-85aecfcb412a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:44.270967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e124-cfbf-4acb-b15b-85aecfcb412a service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:44.271466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e124-cfbf-4acb-b15b-85aecfcb412a service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:44.272090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e124-cfbf-4acb-b15b-85aecfcb412a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:44.303754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e124-cfbf-4acb-b15b-85aecfcb412a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:44.306763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e124-cfbf-4acb-b15b-85aecfcb412a service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:44.329623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1103/2234] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:47.018848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:47.021137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:47.222432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac855-e0a3-49c8-9447-284fecb10952 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:47.232477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:47.233870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:47.234372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:47.234662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] PATH_INFO: `/v3/users/98d8ad21722c482682e5108e6bf8779e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:47.236233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d8ad21722c482682e5108e6bf8779e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:47.239345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:47.337360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d8ad21722c482682e5108e6bf8779e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:47.338797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d8ad21722c482682e5108e6bf8779e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:47.366596 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d8ad21722c482682e5108e6bf8779e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:47.385212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d8ad21722c482682e5108e6bf8779e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:47.409299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d8ad21722c482682e5108e6bf8779e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:47.417481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1132/2235] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:47 2022] DELETE /identity/v3/users/98d8ad21722c482682e5108e6bf8779e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:47.423357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:47.424183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:47.424183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:47.445476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:47.447050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:47.554192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1104/2236] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:47.592112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:47.594424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:47.618686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:47.712248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8362196-fd8b-4551-8c22-d0267fe6289f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:47.716802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:47.717471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:47.717749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:47.718043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:47.728783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:47.730285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:47.742498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1133/2237] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:48.404649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:48.409049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:48.462714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b495d5-e088-457a-95ac-b55ee4eac4b0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:48.488596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:48.490557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:48.494770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:48.496851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] PATH_INFO: `/v3/projects/09a70197e6d24abca5c8e2f9d8eb7ed9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:48.502304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a70197e6d24abca5c8e2f9d8eb7ed9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:48.511455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:48.720384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a70197e6d24abca5c8e2f9d8eb7ed9', 'request_id': 'req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:48.740458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a70197e6d24abca5c8e2f9d8eb7ed9', 'request_id': 'req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:48.753554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a70197e6d24abca5c8e2f9d8eb7ed9', 'request_id': 'req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:48.783421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] The token cache is being invalidate because project 09a70197e6d24abca5c8e2f9d8eb7ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:48.783993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:48.785138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:48.787403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1105/2238] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:48 2022] DELETE /identity/v3/projects/09a70197e6d24abca5c8e2f9d8eb7ed9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:48.793233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:48.814459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba7b47-8e38-41d5-a286-a176511ad4d8 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:48.943271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:48.944693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:48.945103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:48.945641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] PATH_INFO: `/v3/users/ed626c56f8b04ce8935bdaadbbb2809d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:48.947569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed626c56f8b04ce8935bdaadbbb2809d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:48.949877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:49.009990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed626c56f8b04ce8935bdaadbbb2809d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:49.010650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed626c56f8b04ce8935bdaadbbb2809d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:49.018586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed626c56f8b04ce8935bdaadbbb2809d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:49.028980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed626c56f8b04ce8935bdaadbbb2809d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:49.044832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29bd67c6-4f51-4507-b5ae-4b97920ffd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed626c56f8b04ce8935bdaadbbb2809d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:49.051761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1134/2239] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:48 2022] DELETE /identity/v3/users/ed626c56f8b04ce8935bdaadbbb2809d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:49.817463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:49.819936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:49.836262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ed8ca-4b29-46d3-9a1c-e8368bc05633 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:49.897338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:49.912481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:49.913408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:49.913691 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:49.913987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] PATH_INFO: `/v3/projects/a098c3fa780a43f5b02525308fc985c5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:49.917382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a098c3fa780a43f5b02525308fc985c5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:49.919493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.025097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a098c3fa780a43f5b02525308fc985c5', 'request_id': 'req-26dae969-c995-4e2b-ac7f-fa67649360a9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:50.037644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a098c3fa780a43f5b02525308fc985c5', 'request_id': 'req-26dae969-c995-4e2b-ac7f-fa67649360a9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:50.047806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a098c3fa780a43f5b02525308fc985c5', 'request_id': 'req-26dae969-c995-4e2b-ac7f-fa67649360a9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:50.079384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] The token cache is being invalidate because project a098c3fa780a43f5b02525308fc985c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:50.079588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:50.081101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-26dae969-c995-4e2b-ac7f-fa67649360a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:50.083364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1106/2240] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:49 2022] DELETE /identity/v3/projects/a098c3fa780a43f5b02525308fc985c5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:50.089663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.089663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.090347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.135816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:50.137321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:50.172759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:50.280835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1135/2241] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:50.284723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.285314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.285762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.308978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:50.310817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:50.319710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1107/2242] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:50.324557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.341712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5488f23-f7dd-4db7-a211-767ca80ff21f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:50.348216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:50.349233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.349692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.350220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.351408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:50.351913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:50.355179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.379987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1136/2243] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:50.385163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.414889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885422e-9008-4b62-8382-e0eb95d022a0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:50.438564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:50.439442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.439730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.440054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.440831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:50.442954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.487772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.496246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1108/2244] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:50 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:50.514031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76667a-8f71-4813-bba8-1a61abcea25f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:50.597675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:50.598557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.598846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.599125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.599833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:50.601827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.625889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1137/2245] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:50 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:50.630158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.644016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e727ea-c18d-4787-b528-242d4ed5724e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:50.649490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:50.651279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.651279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.651279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.654529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:50.656266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.668601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1109/2246] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:50.672468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.683953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d4472-4f1c-4e81-ae91-0c3c4e87766d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:50.697379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86307e95-745f-47fa-a0b3-7e06499f0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:50.698234 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86307e95-745f-47fa-a0b3-7e06499f0c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.698517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86307e95-745f-47fa-a0b3-7e06499f0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.698786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86307e95-745f-47fa-a0b3-7e06499f0c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.703381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86307e95-745f-47fa-a0b3-7e06499f0c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:50.703381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86307e95-745f-47fa-a0b3-7e06499f0c47 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.722547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1138/2247] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:50.726525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.739293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e7a3f-be30-40e6-992b-dac17d6ec5da admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:50.744807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:50.746081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.747962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.748270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] PATH_INFO: `/v3/projects/4f76f49608fc4fe2ba129befae8153f3/users/5d87ad0942cf4b92a9708fb5caab1112/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.772539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f76f49608fc4fe2ba129befae8153f3, user_id=5d87ad0942cf4b92a9708fb5caab1112, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:50.775563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:50.796948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1110/2248] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:50 2022] PUT /identity/v3/projects/4f76f49608fc4fe2ba129befae8153f3/users/5d87ad0942cf4b92a9708fb5caab1112/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:50.808961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:50.809275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:50.809669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:50.857285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] MFA Rules not processed for user `5d87ad0942cf4b92a9708fb5caab1112`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:50.860177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:50.955286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1139/2249] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:50.976952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:50.978313 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:51.067646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b3e91-4b30-40ca-8629-52c5c48a7a16 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:51.073245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e1c14-500f-442f-a23d-d58cf912e39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:51.074501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1c14-500f-442f-a23d-d58cf912e39b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:51.075062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1c14-500f-442f-a23d-d58cf912e39b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:51.076310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1c14-500f-442f-a23d-d58cf912e39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:51.093352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e1c14-500f-442f-a23d-d58cf912e39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:51.095274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e1c14-500f-442f-a23d-d58cf912e39b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:51.108745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1111/2250] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:51.133399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:51.181121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:51.299438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d2b5-5696-4aae-983b-e6ab50a19430 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:51.315595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:51.317392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:51.318078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:51.318712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] PATH_INFO: `/v3/users/5d87ad0942cf4b92a9708fb5caab1112` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:51.321769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d87ad0942cf4b92a9708fb5caab1112)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:51.325751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:51.416182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d87ad0942cf4b92a9708fb5caab1112'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:51.417065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d87ad0942cf4b92a9708fb5caab1112'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:51.427819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d87ad0942cf4b92a9708fb5caab1112'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:51.447000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d87ad0942cf4b92a9708fb5caab1112'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:51.479644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d87ad0942cf4b92a9708fb5caab1112'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:51.531754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1140/2251] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:51 2022] DELETE /identity/v3/users/5d87ad0942cf4b92a9708fb5caab1112 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:51.533566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:51.534028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:51.534493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:51.564708 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:51.566683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:51.592397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:51.692594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1112/2252] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:51.707767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:51.708599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:51.816752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296908f-5fdf-4854-9c7e-3310ad7893ff admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:51.823043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2c557-b94f-40f2-9b2e-b17653b0609c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:51.824211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c557-b94f-40f2-9b2e-b17653b0609c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:51.824712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c557-b94f-40f2-9b2e-b17653b0609c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:51.825896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c557-b94f-40f2-9b2e-b17653b0609c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:51.846368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2c557-b94f-40f2-9b2e-b17653b0609c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:51.849300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2c557-b94f-40f2-9b2e-b17653b0609c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:51.868788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1141/2253] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:52.400610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:52.402537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:52.416196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0abe-30f3-4165-993b-0ef36147b27a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:52.431732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:52.433301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:52.433829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:52.434990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] PATH_INFO: `/v3/projects/4f76f49608fc4fe2ba129befae8153f3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:52.438360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f76f49608fc4fe2ba129befae8153f3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:52.443270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:52.557655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f76f49608fc4fe2ba129befae8153f3', 'request_id': 'req-3aaf9818-43fb-4bc0-8381-c2911e28034e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:52.569739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f76f49608fc4fe2ba129befae8153f3', 'request_id': 'req-3aaf9818-43fb-4bc0-8381-c2911e28034e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:52.582394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f76f49608fc4fe2ba129befae8153f3', 'request_id': 'req-3aaf9818-43fb-4bc0-8381-c2911e28034e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:52.599136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] The token cache is being invalidate because project 4f76f49608fc4fe2ba129befae8153f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:52.599433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:52.600116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3aaf9818-43fb-4bc0-8381-c2911e28034e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:52.601738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1113/2254] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:52 2022] DELETE /identity/v3/projects/4f76f49608fc4fe2ba129befae8153f3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:52.608122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:52.608956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:52.608956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:52.628669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:52.630384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:52.692932 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:52.732865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1142/2255] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:52.747276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:52.747783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:52.748273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:52.774277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:52.775759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:52.786567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1114/2256] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:52.791189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:52.804090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d7352-caff-4a48-8368-e2373ccb0b3d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:52.812689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:52.814181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:52.814610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:52.815010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:52.815896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:52.816332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:52.818757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:52.862092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1143/2257] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:52.869342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:52.883835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4fd83-0b69-482f-8469-f5606bf92e10 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:52.891957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:52.893263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:52.893777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:52.894327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:52.895676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:52.898368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:52.943609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1115/2258] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:52 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:52.944447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:52.958896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8227b8-9691-40d0-bf00-2bf6b9cddceb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:53.034148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:53.034936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.035281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.035611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.036372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:53.038710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:53.065369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1144/2259] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:52 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:53.070017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:53.081785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e265481-3aa2-4a5d-bfcb-b756f654c74a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:53.088217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:53.088916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.089221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.089478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.090335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:53.092002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:53.104135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1116/2260] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:53.110602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:53.121495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06a00-977f-4412-88ef-b43d738c59d6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:53.127323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e6a93-35fe-4517-8acb-4e3e6b86f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:53.128229 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6a93-35fe-4517-8acb-4e3e6b86f086 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.128573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6a93-35fe-4517-8acb-4e3e6b86f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.128981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6a93-35fe-4517-8acb-4e3e6b86f086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.129774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e6a93-35fe-4517-8acb-4e3e6b86f086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:53.131512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e6a93-35fe-4517-8acb-4e3e6b86f086 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:53.151309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1145/2261] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:53.156057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:53.167415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901040-5e3f-4fdb-9b39-fa04c4e60fe6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:53.175724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:53.177447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.177986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.178497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] PATH_INFO: `/v3/projects/3ce4673bf06c4c10827a44f9d6218d2e/users/051b5ef4f77d44ceb7e33d48f9ad33ba/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.208972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce4673bf06c4c10827a44f9d6218d2e, user_id=051b5ef4f77d44ceb7e33d48f9ad33ba, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:53.212283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:53.227587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1117/2262] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:53 2022] PUT /identity/v3/projects/3ce4673bf06c4c10827a44f9d6218d2e/users/051b5ef4f77d44ceb7e33d48f9ad33ba/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:53.239574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.240295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.240861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.287211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] MFA Rules not processed for user `051b5ef4f77d44ceb7e33d48f9ad33ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:53.289461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:53.403984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1146/2263] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:53.421531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:53.423636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:53.498094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:53.521086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5fd01-c5a4-48cb-99a5-3ab51937a65d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:53.527065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c36b-e089-4482-b257-6af50780256c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:53.528975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c36b-e089-4482-b257-6af50780256c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.529335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c36b-e089-4482-b257-6af50780256c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.529688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c36b-e089-4482-b257-6af50780256c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.543403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c36b-e089-4482-b257-6af50780256c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:53.545580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c36b-e089-4482-b257-6af50780256c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:53.557748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1118/2264] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:53.588525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:53.671564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:53.716402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5feaa-a791-412c-b3d5-32fec87e537b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:53.722551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:53.723609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.724115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.724432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] PATH_INFO: `/v3/users/051b5ef4f77d44ceb7e33d48f9ad33ba` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.726373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051b5ef4f77d44ceb7e33d48f9ad33ba)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:53.730193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:53.810605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051b5ef4f77d44ceb7e33d48f9ad33ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:53.811538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051b5ef4f77d44ceb7e33d48f9ad33ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:53.822483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051b5ef4f77d44ceb7e33d48f9ad33ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:53.835046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051b5ef4f77d44ceb7e33d48f9ad33ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:53.852471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051b5ef4f77d44ceb7e33d48f9ad33ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:53.865045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1147/2265] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:53 2022] DELETE /identity/v3/users/051b5ef4f77d44ceb7e33d48f9ad33ba => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:53.872026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:53.872497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:53.872987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:53.928679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:53.932059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:54.059951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1119/2266] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:54.078139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:54.080852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:54.172210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670eb2-03f3-4f0d-80ca-fcc77bf2ed84 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:54.178857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a21c1-5a72-4304-a3cc-7512fea7d0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:54.180108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a21c1-5a72-4304-a3cc-7512fea7d0cc service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:54.180630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a21c1-5a72-4304-a3cc-7512fea7d0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:54.181136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a21c1-5a72-4304-a3cc-7512fea7d0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:54.205809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a21c1-5a72-4304-a3cc-7512fea7d0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:54.205809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a21c1-5a72-4304-a3cc-7512fea7d0cc service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:54.220566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1148/2267] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:54.566842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:54.568440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:54.581604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858b26d-76b6-4f70-bc7e-0c11183e707a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:54.586958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:54.587952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:54.588296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:54.588680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] PATH_INFO: `/v3/projects/3ce4673bf06c4c10827a44f9d6218d2e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:54.590277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce4673bf06c4c10827a44f9d6218d2e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:54.593528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:54.646689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce4673bf06c4c10827a44f9d6218d2e', 'request_id': 'req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:54.654091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce4673bf06c4c10827a44f9d6218d2e', 'request_id': 'req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:54.661941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce4673bf06c4c10827a44f9d6218d2e', 'request_id': 'req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:54.678869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] The token cache is being invalidate because project 3ce4673bf06c4c10827a44f9d6218d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:54.679221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:54.679918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1d8a3f5c-0d96-4703-bf77-3a0b9e0e3358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:54.682012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1120/2268] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:54 2022] DELETE /identity/v3/projects/3ce4673bf06c4c10827a44f9d6218d2e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:54.687981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:54.688617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:54.688617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:54.714375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:54.715739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:54.773200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:54.785035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1149/2269] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:54.792952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:54.793236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:54.793514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:54.815035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:54.816214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:54.826148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1121/2270] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:54.830695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:54.840798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a591f0-3ece-4229-a940-4197d3aa0a95 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:54.846079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:54.846750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:54.847035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:54.847318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:54.848043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:54.848355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:54.850002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:54.867321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1150/2271] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:54.872301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:54.890979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49bc3e-a657-469b-9218-febce90a1771 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:54.897043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:54.897796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:54.898277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:54.899053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:54.899348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:54.901710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:54.936399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1122/2272] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:54 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:54.942701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:54.960350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cac9a-ee85-4973-8281-da80bc5fbe89 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:55.089734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:55.092635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.092635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.093047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.094605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:55.098185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:55.158660 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:55.159266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1151/2273] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:54 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:55.171630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4da50-c834-4f91-b7a9-b391583959b0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:55.178999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:55.179650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.179962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.180224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.180967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:55.183607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:55.205597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1123/2274] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:55.208014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:55.227871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88a2c-5790-416b-81fe-1c2c3826a1c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:55.238573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b1786-a2ff-49d7-a57d-8e7d8327fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:55.239779 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b1786-a2ff-49d7-a57d-8e7d8327fa65 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.246363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b1786-a2ff-49d7-a57d-8e7d8327fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.246363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b1786-a2ff-49d7-a57d-8e7d8327fa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.246363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b1786-a2ff-49d7-a57d-8e7d8327fa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:55.246363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b1786-a2ff-49d7-a57d-8e7d8327fa65 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:55.267585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1152/2275] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:55.276546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:55.289811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4ce64-1d42-482f-a8ea-1e0778202ea5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:55.297106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:55.298306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.298700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.299288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] PATH_INFO: `/v3/projects/72e06b3022af4399b0d40a30e0df1601/users/0839355522a04a93b17d249bb90dadf5/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.341071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e06b3022af4399b0d40a30e0df1601, user_id=0839355522a04a93b17d249bb90dadf5, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:55.344958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:55.369514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1124/2276] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:55 2022] PUT /identity/v3/projects/72e06b3022af4399b0d40a30e0df1601/users/0839355522a04a93b17d249bb90dadf5/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:55.381152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.381525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.381895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.418934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] MFA Rules not processed for user `0839355522a04a93b17d249bb90dadf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:55.420337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:55.519820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:55.521614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:55.537772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:55.538012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1153/2277] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:55.570083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:55.571887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:55.642498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741190-015c-4970-8b68-b0f6858c0bbb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:55.649844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:55.652319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.652727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.653627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] PATH_INFO: `/v3/users/467a1d5404694cb99391bac7183df993` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.655180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467a1d5404694cb99391bac7183df993)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:55.657376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:55.664351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fb56-226b-43d6-b952-b82dab5cad37 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:55.670529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa905-1cf2-42ca-a5d7-072aecaba022 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:55.671443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa905-1cf2-42ca-a5d7-072aecaba022 service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.671994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa905-1cf2-42ca-a5d7-072aecaba022 service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.672522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa905-1cf2-42ca-a5d7-072aecaba022 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.690872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa905-1cf2-42ca-a5d7-072aecaba022 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:55.692416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa905-1cf2-42ca-a5d7-072aecaba022 service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:55.696633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:55.705623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1154/2278] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:55.762081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467a1d5404694cb99391bac7183df993'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:55.816070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467a1d5404694cb99391bac7183df993'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:55.846373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467a1d5404694cb99391bac7183df993'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:55.847473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467a1d5404694cb99391bac7183df993'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:55.878902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467a1d5404694cb99391bac7183df993'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:55.892439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1125/2279] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:25:55 2022] DELETE /identity/v3/users/467a1d5404694cb99391bac7183df993 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:55.897005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:55.897626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:55.898147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:55.929893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:55.931489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:56.036894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1155/2280] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:25:56.047513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:56.049094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:56.145580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364878-fbec-428e-b916-e74a2f396be4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:56.151937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c70d3-19c1-4dc6-8e16-c7a09f89ccf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:56.152677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c70d3-19c1-4dc6-8e16-c7a09f89ccf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:56.153007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c70d3-19c1-4dc6-8e16-c7a09f89ccf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:56.153283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c70d3-19c1-4dc6-8e16-c7a09f89ccf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:56.169310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c70d3-19c1-4dc6-8e16-c7a09f89ccf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:56.170820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c70d3-19c1-4dc6-8e16-c7a09f89ccf2 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:56.185771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1126/2281] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:25:56.627900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:56.629630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:56.662342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984363-05a1-4ba1-9a6f-e1be9ccd6725 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:56.676520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:56.677656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:56.678028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:56.678382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] PATH_INFO: `/v3/projects/9715109f43254ed68d1b936f0bde08c4` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:56.679990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9715109f43254ed68d1b936f0bde08c4)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:56.683072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:56.755433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9715109f43254ed68d1b936f0bde08c4', 'request_id': 'req-592d569d-bfbe-4de4-8683-b2ffce0f63bc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:56.765698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9715109f43254ed68d1b936f0bde08c4', 'request_id': 'req-592d569d-bfbe-4de4-8683-b2ffce0f63bc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:56.773884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9715109f43254ed68d1b936f0bde08c4', 'request_id': 'req-592d569d-bfbe-4de4-8683-b2ffce0f63bc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:56.797104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] The token cache is being invalidate because project 9715109f43254ed68d1b936f0bde08c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:25:56.797802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:56.799342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-592d569d-bfbe-4de4-8683-b2ffce0f63bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:25:56.801345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1156/2282] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:25:56 2022] DELETE /identity/v3/projects/9715109f43254ed68d1b936f0bde08c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:25:56.807920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:56.808925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:56.808925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:56.836196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:56.837570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:56.881673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:56.957067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1127/2283] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:56.968053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:56.968053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:56.968053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:56.992497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:56.993803 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:57.002848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1157/2284] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:57.007230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.019214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb8618-e4d9-47f5-a06a-054f940b2a17 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.024427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.025113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.025398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.025676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.027438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:25:57.028299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.030133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.046428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1128/2285] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:25:57.051671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.060889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be9605-2c41-4d91-aa11-491ad9ef89c0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.066966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.067957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.068519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.068772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.069514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.071518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.111854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1158/2286] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:25:57 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:25:57.113491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.127768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b264-8da4-41d5-8749-8658e6e3fcf4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.239200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.241140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.242072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.242986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.244607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.248797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.292748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1129/2287] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:25:57 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:25:57.303386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.318116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59600f-b148-4e04-95d8-a77935a4e5bb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.323227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.323952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.324261 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.325815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.325815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.327621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.341189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1159/2288] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:57.348163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.367450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d04bf-b2ae-4221-ac3a-777aefceff84 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.375896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17241677-7130-4f60-b9e7-e08df3e13887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.377033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17241677-7130-4f60-b9e7-e08df3e13887 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.377536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17241677-7130-4f60-b9e7-e08df3e13887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.378226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17241677-7130-4f60-b9e7-e08df3e13887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.379679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17241677-7130-4f60-b9e7-e08df3e13887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.382882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17241677-7130-4f60-b9e7-e08df3e13887 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.408183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1130/2289] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:25:57.411926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.430646 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dae8a-8d89-4d85-9a58-77a491780bd0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.438287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.439903 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.440514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.441026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] PATH_INFO: `/v3/projects/c8639e94db83484db062e3b4a1120a39/users/471604cbdeba4f4fafbb1d88734fd18f/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.471243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8639e94db83484db062e3b4a1120a39, user_id=471604cbdeba4f4fafbb1d88734fd18f, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.477356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.516594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1160/2290] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:25:57 2022] PUT /identity/v3/projects/c8639e94db83484db062e3b4a1120a39/users/471604cbdeba4f4fafbb1d88734fd18f/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:25:57.523589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5b2c-417f-41d8-8764-65235e915296 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.523994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5b2c-417f-41d8-8764-65235e915296 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.524280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a5b2c-417f-41d8-8764-65235e915296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.546539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6c3a5b2c-417f-41d8-8764-65235e915296 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:57.547927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c3a5b2c-417f-41d8-8764-65235e915296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:57.679723 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1131/2291] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:25:57.695133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:25:57.697377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:57.745613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:57.851588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47974f-c06e-40cb-b589-3f2964ede71c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:25:57.870699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:25:57.872713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:57.873019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:57.873429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:57.907517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:25:57.909102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:25:57.943760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1161/2292] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:25:59.883916 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e1dc-49e4-445c-a483-c92ee5004680 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:25:59.884808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e1dc-49e4-445c-a483-c92ee5004680 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:25:59.884808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0e1dc-49e4-445c-a483-c92ee5004680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:25:59.915479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-93d0e1dc-49e4-445c-a483-c92ee5004680 None None] MFA Rules not processed for user `471604cbdeba4f4fafbb1d88734fd18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:25:59.916748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-93d0e1dc-49e4-445c-a483-c92ee5004680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:25:59.939950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:00.021369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1132/2293] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:25:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:00.036984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:00.039219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:00.117808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce294-01d5-4899-8a82-199ee0247281 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:00.121867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:00.122572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:00.122940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:00.123214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:00.134588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:00.136067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:00.147480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1162/2294] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:26:00.328493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadcbf7-4c78-4457-91e7-549f8f25d03a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:00.329005 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadcbf7-4c78-4457-91e7-549f8f25d03a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:00.329500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadcbf7-4c78-4457-91e7-549f8f25d03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:00.377245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cbadcbf7-4c78-4457-91e7-549f8f25d03a None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:00.378498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cbadcbf7-4c78-4457-91e7-549f8f25d03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:00.458232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1133/2295] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:26:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:00.533196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:00.535558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:00.636564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de09161-33cb-49f1-8c85-b973a664299c service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:00.646214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45792e67-c05f-4324-b8a7-7c8f98cf9c13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:00.646920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792e67-c05f-4324-b8a7-7c8f98cf9c13 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:00.647202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792e67-c05f-4324-b8a7-7c8f98cf9c13 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:00.647481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45792e67-c05f-4324-b8a7-7c8f98cf9c13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:00.658956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792e67-c05f-4324-b8a7-7c8f98cf9c13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:00.660663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45792e67-c05f-4324-b8a7-7c8f98cf9c13 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:00.684313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1163/2296] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:26:01.860281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234dce-0c98-4c89-9231-2326883db57e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:01.861803 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234dce-0c98-4c89-9231-2326883db57e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:01.863164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234dce-0c98-4c89-9231-2326883db57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:01.899186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-61234dce-0c98-4c89-9231-2326883db57e None None] MFA Rules not processed for user `471604cbdeba4f4fafbb1d88734fd18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:01.901392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61234dce-0c98-4c89-9231-2326883db57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:01.920441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1134/2297] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:10.666638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=76 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:11.891956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=53 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:14.409927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543916-9415-4a09-bdf6-e9ebf1bf29e3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:14.410613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543916-9415-4a09-bdf6-e9ebf1bf29e3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:14.411114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543916-9415-4a09-bdf6-e9ebf1bf29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:14.437651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-51543916-9415-4a09-bdf6-e9ebf1bf29e3 None None] MFA Rules not processed for user `4a9445ed7a4645af8e578d797e7900da`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:14.439995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-51543916-9415-4a09-bdf6-e9ebf1bf29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:14.545891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1164/2298] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:24.536538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=25 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:28.348237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234dce-0c98-4c89-9231-2326883db57e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:28.352015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61234dce-0c98-4c89-9231-2326883db57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:28.374688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234dce-0c98-4c89-9231-2326883db57e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:28.381383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:28.382347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:28.382630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:28.382912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] PATH_INFO: `/v3/users/0839355522a04a93b17d249bb90dadf5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:28.384399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0839355522a04a93b17d249bb90dadf5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:28.388342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:28.469524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:28.470404 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:28.471020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:28.493038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0839355522a04a93b17d249bb90dadf5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:28.518520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0839355522a04a93b17d249bb90dadf5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:28.535349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0839355522a04a93b17d249bb90dadf5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:28.536541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0839355522a04a93b17d249bb90dadf5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:28.546780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:28.548338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:28.552956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-22bb2577-38ff-4bc4-91c0-24f4f1d99b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0839355522a04a93b17d249bb90dadf5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:28.566866 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1135/2299] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:26:28 2022] DELETE /identity/v3/users/0839355522a04a93b17d249bb90dadf5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:28.572236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:28.572804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:28.573611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:28.578024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1165/2300] 10.222.0.61 () {58 vars in 967 bytes} [Fri May 27 03:26:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:26:28.593537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:28.595965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:28.623370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:28.625580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:28.712343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144bc5-3225-4d12-aebd-058eaaa474a2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:28.799109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1136/2301] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:28.818279 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:28.819924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:28.849854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1776b2f-5a3b-44f5-8281-4a0b9ea40309 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:28.850558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776b2f-5a3b-44f5-8281-4a0b9ea40309 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:28.850843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776b2f-5a3b-44f5-8281-4a0b9ea40309 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:28.854502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776b2f-5a3b-44f5-8281-4a0b9ea40309 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.000580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8588c9-c147-4b50-8bbd-11a89e8bdd6c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:29.009577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:29.010816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:29.012082 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:29.012267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.034785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:29.039245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:29.073634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1137/2302] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:26:29.097048 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1776b2f-5a3b-44f5-8281-4a0b9ea40309 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:29.100395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1776b2f-5a3b-44f5-8281-4a0b9ea40309 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:29.135740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1166/2303] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:26:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:26:29.501711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:29.504884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:29.542996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563a68f-1558-4623-b096-9b3a2d93a718 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:29.552832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:29.554625 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:29.555063 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:29.555678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] PATH_INFO: `/v3/projects/72e06b3022af4399b0d40a30e0df1601` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.558493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e06b3022af4399b0d40a30e0df1601)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:29.562434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:29.581285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:29.659400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e06b3022af4399b0d40a30e0df1601', 'request_id': 'req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:29.674581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e06b3022af4399b0d40a30e0df1601', 'request_id': 'req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:29.685416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e06b3022af4399b0d40a30e0df1601', 'request_id': 'req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:29.702368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] The token cache is being invalidate because project 72e06b3022af4399b0d40a30e0df1601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:26:29.702921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:29.703671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fac75abc-cfb1-4434-ac1d-6116a89bf4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:29.705467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1138/2304] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:26:29 2022] DELETE /identity/v3/projects/72e06b3022af4399b0d40a30e0df1601 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:26:29.710590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:29.711660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:29.711660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.735409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:29.737318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:29.823690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:29.855248 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1167/2305] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:29.864801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:29.865078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:29.865355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.893425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:29.895689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:29.911258 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1139/2306] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:29.916919 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:29.929660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df33fd-b60c-48e2-9aeb-7a021e0b8bbb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:29.935501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:29.936184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:29.936465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:29.936734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.937498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:26:29.937853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:29.939718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:29.960329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1168/2307] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:26:29.961792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:29.972925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d4077-7060-47af-a328-f12c2861458b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:29.979759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:29.981160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:29.981681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:29.982224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:29.984343 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:29.988236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:30.034439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1140/2308] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:26:29 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:26:30.040291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:30.057076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b515f-83d3-4609-9b98-d008f94efa30 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:30.183191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:30.184053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:30.184352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:30.184641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:30.185356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:30.187439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:30.242319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1169/2309] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:26:30 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:26:30.249596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:30.274588 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015acf-6c6b-49e9-9bc1-afbd3a72f5d1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:30.286140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:30.287362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:30.288809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:30.290531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:30.294251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:30.295943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:30.315233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1141/2310] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:26:30.316388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:30.343439 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7bae9-b107-49ce-adae-517fa2ebe067 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:30.352822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35751b7a-db2a-4a07-bd83-3ab361714b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:30.354363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751b7a-db2a-4a07-bd83-3ab361714b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:30.355195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751b7a-db2a-4a07-bd83-3ab361714b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:30.355948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751b7a-db2a-4a07-bd83-3ab361714b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:30.357648 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35751b7a-db2a-4a07-bd83-3ab361714b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:30.368146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35751b7a-db2a-4a07-bd83-3ab361714b27 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:30.386778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1170/2311] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:26:30.393280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:30.412158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13331ac8-4eb5-4b97-99b6-a1bf5deb41aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:30.420972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:30.422487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:30.422970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:30.423439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] PATH_INFO: `/v3/projects/45d4e667b087450bbf1221f36c9856b7/users/c65cf36142814ccbb29c5d8efc38cea9/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:30.450471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d4e667b087450bbf1221f36c9856b7, user_id=c65cf36142814ccbb29c5d8efc38cea9, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:30.453472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:30.478654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1142/2312] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:26:30 2022] PUT /identity/v3/projects/45d4e667b087450bbf1221f36c9856b7/users/c65cf36142814ccbb29c5d8efc38cea9/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:30.510059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d814c-f4ca-48e8-801a-9b5e6284995b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:30.510059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d814c-f4ca-48e8-801a-9b5e6284995b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:30.511089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d814c-f4ca-48e8-801a-9b5e6284995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:30.560353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ef3d814c-f4ca-48e8-801a-9b5e6284995b None None] MFA Rules not processed for user `c65cf36142814ccbb29c5d8efc38cea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:30.563424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef3d814c-f4ca-48e8-801a-9b5e6284995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:30.734751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1171/2313] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:26:30.750624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:30.753069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:30.874114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0bf89-cf22-46ec-b0f4-9f2b2093f91d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:30.880891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8fee-05e4-41d9-81db-5016474d6723 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:30.882100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8fee-05e4-41d9-81db-5016474d6723 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:30.882543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8fee-05e4-41d9-81db-5016474d6723 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:30.883029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8fee-05e4-41d9-81db-5016474d6723 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:30.899848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d8fee-05e4-41d9-81db-5016474d6723 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:30.902766 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d8fee-05e4-41d9-81db-5016474d6723 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:30.921529 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1143/2314] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:26:31.712826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cdea-a27c-4718-a13d-712a5bb97864 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:31.713494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cdea-a27c-4718-a13d-712a5bb97864 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:31.714135 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cdea-a27c-4718-a13d-712a5bb97864 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:31.717425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1172/2315] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:26:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:26:31.750328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:31.750939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:31.751536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:31.806451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:31.886434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] MFA Rules not processed for user `f2e7c7b4f94b4830adc49cf2f4b84d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:31.889771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:31.912905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cdea-a27c-4718-a13d-712a5bb97864 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:31.920928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-99f8cdea-a27c-4718-a13d-712a5bb97864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:32.019692 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:32.069482 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1144/2316] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:26:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:32.074046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8cdea-a27c-4718-a13d-712a5bb97864 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:32.082465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:32.084868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:32.088583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:32.090785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:32.091274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:32.091601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] PATH_INFO: `/v3/users/71d99aa30493428897ca7c8c2909a4f8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:32.093102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d99aa30493428897ca7c8c2909a4f8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:32.095393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:32.099709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4456d-6263-45b0-a35d-2a4d3d50ddc2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:32.112346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:32.113575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:32.114533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:32.115451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:32.135607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:32.140597 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:32.166203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1145/2317] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:26:32.184327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d99aa30493428897ca7c8c2909a4f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.185333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d99aa30493428897ca7c8c2909a4f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.230607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d99aa30493428897ca7c8c2909a4f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.242321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d99aa30493428897ca7c8c2909a4f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.273597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e583637-c890-4b17-852a-3f69d5cbbb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d99aa30493428897ca7c8c2909a4f8'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.285551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1173/2318] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:26:31 2022] DELETE /identity/v3/users/71d99aa30493428897ca7c8c2909a4f8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:26:32.538586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:32.555696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d9c5d-2e2b-4366-845f-44bb4945cc46 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:32.638886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:32.640139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:32.640662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:32.641104 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] PATH_INFO: `/v3/projects/640eb7d258574c69b824d2d9858d5ba8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:32.642758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640eb7d258574c69b824d2d9858d5ba8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:32.644875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:32.717427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640eb7d258574c69b824d2d9858d5ba8', 'request_id': 'req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.729952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640eb7d258574c69b824d2d9858d5ba8', 'request_id': 'req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.738215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640eb7d258574c69b824d2d9858d5ba8', 'request_id': 'req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.770238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:32.770238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] The token cache is being invalidate because project 640eb7d258574c69b824d2d9858d5ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:26:32.770238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.771834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a6fb07ab-fc05-4953-bbed-e1cf4c9027f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:32.773476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1146/2319] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:26:32 2022] DELETE /identity/v3/projects/640eb7d258574c69b824d2d9858d5ba8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:32.781430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:32.781924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:32.782449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:32.808203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:32.809608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:32.926202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1174/2320] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:32.941640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:32.942346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:32.942819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:32.970333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:32.971929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:32.989408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1147/2321] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:32.997183 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.014121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5835-684b-46bf-a7f8-2677aa80bdf0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:33.021336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:33.024000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.024000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.024000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.024000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:26:33.024546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:33.026546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:33.052442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1175/2322] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:26:33.060616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.083860 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101753da-cb7e-4430-8a02-4a3d2463c8bf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:33.096451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:33.097601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.098123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.098589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.099978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:33.105047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:33.162852 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1148/2323] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:26:33 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:26:33.167876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.193421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed1d5-f0c4-431f-9f76-353ca39e7cfa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:33.300114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:33.336783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:33.337727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.338188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.338790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.339815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:33.342754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:33.390688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1176/2324] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:26:33 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:26:33.395250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.407756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb49d9-0481-42ae-bd8d-43d51e8d5af4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:33.419935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:33.420764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.421043 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.421315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.422224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:33.431253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:33.472163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1149/2325] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:26:33.474232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.523383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f55ee-9115-4aa0-8865-669b814fb4c2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:33.533661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a1da-1b32-4850-b4d2-22b15c2064eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:33.534517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a1da-1b32-4850-b4d2-22b15c2064eb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.535125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a1da-1b32-4850-b4d2-22b15c2064eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.535470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a1da-1b32-4850-b4d2-22b15c2064eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.536908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a1da-1b32-4850-b4d2-22b15c2064eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:33.539751 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a1da-1b32-4850-b4d2-22b15c2064eb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:33.555504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1177/2326] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:26:33.561064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.586128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4bcfc-66fd-43a5-91ee-6fc33ce1bed3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:33.593149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:33.594219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.594903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.595545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] PATH_INFO: `/v3/projects/c4080a1143f64913b3b27d8f22447ed2/users/367343e2acca4f73845e6f819c9bb544/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.634952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4080a1143f64913b3b27d8f22447ed2, user_id=367343e2acca4f73845e6f819c9bb544, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:33.638787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:33.660092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1150/2327] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:26:33 2022] PUT /identity/v3/projects/c4080a1143f64913b3b27d8f22447ed2/users/367343e2acca4f73845e6f819c9bb544/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:33.678882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:33.679189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:33.679479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:33.719448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] MFA Rules not processed for user `367343e2acca4f73845e6f819c9bb544`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:33.721787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:33.854694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1178/2328] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:33.901704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:33.905913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:34.024937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396fafc-02a5-40c2-956f-deab595c97f5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:34.029218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa91d-c58f-4159-a069-74d2748c7d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:34.029898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa91d-c58f-4159-a069-74d2748c7d1f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:34.030256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa91d-c58f-4159-a069-74d2748c7d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:34.030531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa91d-c58f-4159-a069-74d2748c7d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:34.041083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa91d-c58f-4159-a069-74d2748c7d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:34.043200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa91d-c58f-4159-a069-74d2748c7d1f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:34.053376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1151/2329] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:26:34.091235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:34.163591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5543a2-c512-44fa-9e7a-16e49438097e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:34.168771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:34.173935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:34.173935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:34.173935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] PATH_INFO: `/v3/users/367343e2acca4f73845e6f819c9bb544` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:34.175400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367343e2acca4f73845e6f819c9bb544)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:34.178213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:34.238471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367343e2acca4f73845e6f819c9bb544'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:34.239347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367343e2acca4f73845e6f819c9bb544'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:34.246179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:34.249201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367343e2acca4f73845e6f819c9bb544'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:34.261864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367343e2acca4f73845e6f819c9bb544'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:34.281882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367343e2acca4f73845e6f819c9bb544'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:34.289978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1179/2330] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:26:34 2022] DELETE /identity/v3/users/367343e2acca4f73845e6f819c9bb544 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:34.299158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:34.299585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:34.299961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:34.325819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:34.327123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:34.410295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1152/2331] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:34.420898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:34.422697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:34.491679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a442a6-7c6e-4f78-bdab-14ef93b75806 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:34.502952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9788-1b00-4664-ae93-d4d21381996a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:34.503636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9788-1b00-4664-ae93-d4d21381996a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:34.503992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9788-1b00-4664-ae93-d4d21381996a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:34.506271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9788-1b00-4664-ae93-d4d21381996a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:34.525473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e9788-1b00-4664-ae93-d4d21381996a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:34.528424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e9788-1b00-4664-ae93-d4d21381996a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:34.548547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1180/2332] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:26:35.032839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.035519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:35.061650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857b8a2-c305-4db5-9264-6a9b232065f1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.070654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.071904 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.072287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.073192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] PATH_INFO: `/v3/projects/c4080a1143f64913b3b27d8f22447ed2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.075493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4080a1143f64913b3b27d8f22447ed2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.080795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.103203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:35.157661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4080a1143f64913b3b27d8f22447ed2', 'request_id': 'req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:35.164153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4080a1143f64913b3b27d8f22447ed2', 'request_id': 'req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:35.171491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4080a1143f64913b3b27d8f22447ed2', 'request_id': 'req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:35.188044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] The token cache is being invalidate because project c4080a1143f64913b3b27d8f22447ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:26:35.188520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:35.189644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d2b179ed-e65d-4761-9eaa-34aa68e07f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:35.192416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1153/2333] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:26:35 2022] DELETE /identity/v3/projects/c4080a1143f64913b3b27d8f22447ed2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:35.200115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.200703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.201079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.224822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:35.226107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:35.302243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1181/2334] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:35.314187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.314679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.315128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.343141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:35.344630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:35.353110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1154/2335] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:35.357762 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.368936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0f48-5be9-474b-aaf5-7bf2bfa32c6f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.374910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.375706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.376036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.376359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.377150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:26:35.377504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.379465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.393464 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1182/2336] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:26:35.398418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.409454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7415b42-36bc-48bb-b8e0-db4fd47648b9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.416150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.416878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.417161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.417539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.418422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.420564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.450435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1155/2337] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:26:35 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:26:35.454756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.466422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4cf0b-dbb5-4952-b6cc-14e5adfb096c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.546252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.547447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.547959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.548474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.549807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.553860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.567473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:35.588136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1183/2338] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:26:35 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:26:35.593321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.608464 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8f8ea-654c-4ee5-96ba-31cf7327b53d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.614629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.615408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.615754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.616081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.617294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.619058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.632232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1156/2339] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:26:35.637044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.648542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d56ac2-a044-4338-913d-3e1f6cd04bd1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.653582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291752-bdc1-4f14-b089-014f5f919172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.654314 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291752-bdc1-4f14-b089-014f5f919172 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.654602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291752-bdc1-4f14-b089-014f5f919172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.654879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291752-bdc1-4f14-b089-014f5f919172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.655642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291752-bdc1-4f14-b089-014f5f919172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.657288 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34291752-bdc1-4f14-b089-014f5f919172 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.671458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1184/2340] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:26:35.676036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.693826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de5c5-3aeb-453c-bf99-d98af7afc537 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.701203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.703035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.703320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.703598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] PATH_INFO: `/v3/projects/ce0c3ef8ac844ce3bf251165073ec2aa/users/7962900806d546e0800a960f92a5d6da/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.721347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0c3ef8ac844ce3bf251165073ec2aa, user_id=7962900806d546e0800a960f92a5d6da, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:35.724142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:35.742844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1157/2341] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:26:35 2022] PUT /identity/v3/projects/ce0c3ef8ac844ce3bf251165073ec2aa/users/7962900806d546e0800a960f92a5d6da/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:26:35.755222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.755561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.755915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:35.786224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] MFA Rules not processed for user `7962900806d546e0800a960f92a5d6da`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:35.787467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:35.868838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1185/2342] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:26:35.882127 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:35.883507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:35.983196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e10948-68ab-4493-83fd-fe9dde354382 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:35.988730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fcb71-040f-4f00-9412-0c6604e7d3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:35.989415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fcb71-040f-4f00-9412-0c6604e7d3ba service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:35.989804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fcb71-040f-4f00-9412-0c6604e7d3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:35.990173 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fcb71-040f-4f00-9412-0c6604e7d3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:36.008549 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fcb71-040f-4f00-9412-0c6604e7d3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:36.011771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fcb71-040f-4f00-9412-0c6604e7d3ba service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:36.033672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1158/2343] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:26:38.387178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:38.388840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:38.485321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3563ca-e916-4b3a-9fc2-03c6b56c46e1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:38.490727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:38.491639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:38.491929 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:38.492190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] PATH_INFO: `/v3/users/ad772551f01343568677b4cff1cbaa1f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:38.493591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad772551f01343568677b4cff1cbaa1f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:38.496164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:38.561469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad772551f01343568677b4cff1cbaa1f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:38.562335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad772551f01343568677b4cff1cbaa1f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:38.571044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad772551f01343568677b4cff1cbaa1f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:38.582530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad772551f01343568677b4cff1cbaa1f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:38.593707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:38.601757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad772551f01343568677b4cff1cbaa1f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:38.612494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1186/2344] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:26:38 2022] DELETE /identity/v3/users/ad772551f01343568677b4cff1cbaa1f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:26:38.617211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:38.617706 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:38.617796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:38.639934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:38.641845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:38.690176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:38.727628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1159/2345] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:38.738629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:38.740435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:38.836824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e42c-05c9-46bb-9e32-eda024f189b7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:38.847429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:38.848119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:38.848423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:38.848820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:38.861451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:38.863034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:38.876862 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1187/2346] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:26:39.567623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:39.569318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:39.590649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86e62-d4fd-4911-8e94-16e059e61dd2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:39.596377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:39.598100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:39.598941 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:39.599587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] PATH_INFO: `/v3/projects/6cf029b3aba44ef4a4793baf09fa7eca` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:39.601816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf029b3aba44ef4a4793baf09fa7eca)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:39.606195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:39.675431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf029b3aba44ef4a4793baf09fa7eca', 'request_id': 'req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:39.683298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf029b3aba44ef4a4793baf09fa7eca', 'request_id': 'req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:39.694931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf029b3aba44ef4a4793baf09fa7eca', 'request_id': 'req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:39.720378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] The token cache is being invalidate because project 6cf029b3aba44ef4a4793baf09fa7eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:26:39.720672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:39.721725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49d1e6ac-1f2a-4198-8c28-f2d2072d547d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:39.724800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1160/2347] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:26:39 2022] DELETE /identity/v3/projects/6cf029b3aba44ef4a4793baf09fa7eca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:26:47.765574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:47.767076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:47.780879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd639-a313-4211-a29c-692df7aa75f0 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:47.851382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:47.852477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:47.852825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:47.853140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] PATH_INFO: `/v3/users/7962900806d546e0800a960f92a5d6da` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:47.854896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7962900806d546e0800a960f92a5d6da)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:47.856973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:47.921300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7962900806d546e0800a960f92a5d6da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:47.922307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7962900806d546e0800a960f92a5d6da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:47.935863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7962900806d546e0800a960f92a5d6da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:47.957816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7962900806d546e0800a960f92a5d6da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:47.975280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7962900806d546e0800a960f92a5d6da'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:47.990787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1188/2348] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:26:47 2022] DELETE /identity/v3/users/7962900806d546e0800a960f92a5d6da => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:26:47.997236 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:47.998088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:47.998088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:48.018496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:26:48.019799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:48.097769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1161/2349] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:26:48.108165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:48.109730 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:48.126926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:48.189209 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd584-131d-4639-bd64-14b763d26ea2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:48.193312 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:48.194013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:48.194299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:48.194575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:48.206260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:48.207734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:48.218631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1189/2350] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:26:48.602776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:48.606676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:48.626392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18897b-1534-4a9e-b345-b3e73584028b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:48.636669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:48.638223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:48.638707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:48.639217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] PATH_INFO: `/v3/projects/ce0c3ef8ac844ce3bf251165073ec2aa` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:48.641611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0c3ef8ac844ce3bf251165073ec2aa)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:48.645414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:48.720052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0c3ef8ac844ce3bf251165073ec2aa', 'request_id': 'req-301a9b6e-498c-451b-a4c2-519061c304ae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:48.729777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0c3ef8ac844ce3bf251165073ec2aa', 'request_id': 'req-301a9b6e-498c-451b-a4c2-519061c304ae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:48.731265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:48.740717 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0c3ef8ac844ce3bf251165073ec2aa', 'request_id': 'req-301a9b6e-498c-451b-a4c2-519061c304ae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:48.757835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] The token cache is being invalidate because project ce0c3ef8ac844ce3bf251165073ec2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:26:48.758183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:48.758844 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301a9b6e-498c-451b-a4c2-519061c304ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:26:48.760540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1162/2351] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:26:48 2022] DELETE /identity/v3/projects/ce0c3ef8ac844ce3bf251165073ec2aa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:26:51.426247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:26:51.429522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:51.570363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15004c-d1a9-4103-8f5f-030bfa6130df service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:26:51.668050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:26:51.668840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:26:51.669238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:26:51.669625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:26:51.671835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:26:51.688737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:26:51.690842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:26:51.708750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1190/2352] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:26:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:26:58.754563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:01.698735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=79 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:07.338854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:07.339737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:07.339894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:07.361428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:07.362965 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:07.453044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1163/2353] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:07.472973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:07.474701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:07.603037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f85ec-8c29-40fb-a6f4-5ddee72ed069 service placement] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:07.608711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa187d1-4302-4b82-8d8c-4ec0c9c8e06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:07.609376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa187d1-4302-4b82-8d8c-4ec0c9c8e06d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:07.609655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa187d1-4302-4b82-8d8c-4ec0c9c8e06d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:07.609928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa187d1-4302-4b82-8d8c-4ec0c9c8e06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:07.619707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa187d1-4302-4b82-8d8c-4ec0c9c8e06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:07.621330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa187d1-4302-4b82-8d8c-4ec0c9c8e06d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:07.634143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1191/2354] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:27:10.525204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:10.527016 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:10.541943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2d85-918b-4186-b67e-d967050c1af8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:10.546963 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:10.547870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:10.548157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:10.548439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] PATH_INFO: `/v3/users/c65cf36142814ccbb29c5d8efc38cea9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:10.550493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65cf36142814ccbb29c5d8efc38cea9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:10.553002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:10.613882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65cf36142814ccbb29c5d8efc38cea9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:10.629018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65cf36142814ccbb29c5d8efc38cea9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:10.640142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65cf36142814ccbb29c5d8efc38cea9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:10.641284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65cf36142814ccbb29c5d8efc38cea9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:10.652603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65cf36142814ccbb29c5d8efc38cea9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:10.660341 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1164/2355] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:27:10 2022] DELETE /identity/v3/users/c65cf36142814ccbb29c5d8efc38cea9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:27:10.667149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114fefc-a45a-47d2-b195-8330b2235286 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:10.667736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114fefc-a45a-47d2-b195-8330b2235286 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:10.668186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114fefc-a45a-47d2-b195-8330b2235286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:10.700247 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0114fefc-a45a-47d2-b195-8330b2235286 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:10.702609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0114fefc-a45a-47d2-b195-8330b2235286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:10.806124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1192/2356] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:10.819724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:10.822832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:10.912967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a141-2866-4f41-9e6b-36c4b7adcbdd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:10.917370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:10.918288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:10.918770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:10.919125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:10.930752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:10.932458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:10.944709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1165/2357] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:27:11.491792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:11.493405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:11.493892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:11.496709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:11.500357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:11.530152 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:11.530486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65228480-949b-4527-8e5c-15f24e558237 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:11.532179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:11.538467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:11.540315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:11.540772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:11.541234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] PATH_INFO: `/v3/projects/45d4e667b087450bbf1221f36c9856b7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:11.542801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d4e667b087450bbf1221f36c9856b7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:11.544478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1193/2358] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:11.545244 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:11.564083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:11.564821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:11.567172 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:11.622389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d4e667b087450bbf1221f36c9856b7', 'request_id': 'req-9c301aac-365c-4ba2-bf87-63cfedbda38d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:11.629744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d4e667b087450bbf1221f36c9856b7', 'request_id': 'req-9c301aac-365c-4ba2-bf87-63cfedbda38d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:11.639540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d4e667b087450bbf1221f36c9856b7', 'request_id': 'req-9c301aac-365c-4ba2-bf87-63cfedbda38d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:11.654538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:11.659523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] The token cache is being invalidate because project 45d4e667b087450bbf1221f36c9856b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:27:11.659921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:11.660733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c301aac-365c-4ba2-bf87-63cfedbda38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:27:11.669552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1166/2359] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:27:11 2022] DELETE /identity/v3/projects/45d4e667b087450bbf1221f36c9856b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:27:11.678030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be1987-9bb0-4d77-af50-63a31c3aff5f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:11.773795 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:11.775040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:11.775540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:11.776042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:11.779783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:11.907607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:11.910733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:11.931052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1194/2360] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:27:15.830039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99053ae3-a91c-4487-9e60-9f7841c3e5b2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:15.830663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99053ae3-a91c-4487-9e60-9f7841c3e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:15.830663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99053ae3-a91c-4487-9e60-9f7841c3e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:15.850892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-99053ae3-a91c-4487-9e60-9f7841c3e5b2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:15.852763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-99053ae3-a91c-4487-9e60-9f7841c3e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:15.861075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1167/2361] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:15.884395 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:15.886292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:15.901834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438a1d-b31c-400e-9c63-1c3083347eb6 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:15.907579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:15.908252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:15.908537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:15.908815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:15.919709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:15.921515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:15.934420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1195/2362] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:27:18.482078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823659-ba77-4836-bf10-8682ac6a2589 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:18.482968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823659-ba77-4836-bf10-8682ac6a2589 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:18.482968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823659-ba77-4836-bf10-8682ac6a2589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:18.502267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-96823659-ba77-4836-bf10-8682ac6a2589 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:18.503516 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96823659-ba77-4836-bf10-8682ac6a2589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:18.568939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1168/2363] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:27:18.592740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:18.594813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:18.680798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea31862-3846-49e0-b073-34e9a5c81a2f service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:18.688610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:18.689739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:18.690295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:18.690804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:18.706926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:18.710197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:18.728834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1196/2364] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 03:27:20.022577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25e04-55b7-4c59-97fc-61fe4f4d8afa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:20.023221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25e04-55b7-4c59-97fc-61fe4f4d8afa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:20.023539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25e04-55b7-4c59-97fc-61fe4f4d8afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:20.056999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bfd25e04-55b7-4c59-97fc-61fe4f4d8afa None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:20.060489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bfd25e04-55b7-4c59-97fc-61fe4f4d8afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:20.077954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1169/2365] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:20.125079 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:20.128577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:20.156666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e7309-1319-415e-90ca-1a566be7e871 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:20.168080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:20.170553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:20.170553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:20.170553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:20.180176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:20.189202 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:20.191927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:20.213207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1197/2366] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:27:24.322531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828d8a-153b-4491-ac82-05f4997e178c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:24.323346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828d8a-153b-4491-ac82-05f4997e178c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:24.323346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828d8a-153b-4491-ac82-05f4997e178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:24.346967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-49828d8a-153b-4491-ac82-05f4997e178c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:24.348213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-49828d8a-153b-4491-ac82-05f4997e178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:24.356804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1170/2367] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:24.373449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:24.395844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d9eef-a066-4ba5-8726-1add1a2d6054 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:24.406350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:24.407531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:24.408037 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:24.408539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:24.425580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:24.428647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:24.449113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1198/2368] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:27:28.664987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e7fe-b068-4449-b8dc-1501ce7e2034 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:28.665813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e7fe-b068-4449-b8dc-1501ce7e2034 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:28.666924 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e7fe-b068-4449-b8dc-1501ce7e2034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:28.721648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9e78e7fe-b068-4449-b8dc-1501ce7e2034 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:28.723488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9e78e7fe-b068-4449-b8dc-1501ce7e2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:28.741432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1171/2369] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:28.787709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:28.817609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08816a-ef35-49f0-94b1-89260fd3f45d service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:28.829384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2cc5e-63aa-44b8-a878-1f955a14e4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:28.830984 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2cc5e-63aa-44b8-a878-1f955a14e4a4 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:28.831790 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2cc5e-63aa-44b8-a878-1f955a14e4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:28.832463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2cc5e-63aa-44b8-a878-1f955a14e4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:28.852503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2cc5e-63aa-44b8-a878-1f955a14e4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:28.855193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2cc5e-63aa-44b8-a878-1f955a14e4a4 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:28.876788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1199/2370] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:27:37.198518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3f19f-4763-4b9c-969c-e049d805cb1f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.199499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3f19f-4763-4b9c-969c-e049d805cb1f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.199499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3f19f-4763-4b9c-969c-e049d805cb1f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.202187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1172/2371] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:27:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:27:37.208885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c9cae-4247-4d80-9122-643ebc6ac1a2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.209773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c9cae-4247-4d80-9122-643ebc6ac1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.209773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c9cae-4247-4d80-9122-643ebc6ac1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.263850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b36c9cae-4247-4d80-9122-643ebc6ac1a2 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:37.265994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b36c9cae-4247-4d80-9122-643ebc6ac1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:37.283300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1200/2372] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:27:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:27:37.304769 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3f19f-4763-4b9c-969c-e049d805cb1f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:37.306764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-57e3f19f-4763-4b9c-969c-e049d805cb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:37.384610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3f19f-4763-4b9c-969c-e049d805cb1f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:37.388634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf2fca-2aaf-4762-802d-2bf18caf0c99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:37.389365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf2fca-2aaf-4762-802d-2bf18caf0c99 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.389822 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf2fca-2aaf-4762-802d-2bf18caf0c99 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.390149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf2fca-2aaf-4762-802d-2bf18caf0c99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.405231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf2fca-2aaf-4762-802d-2bf18caf0c99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:37.408037 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf2fca-2aaf-4762-802d-2bf18caf0c99 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:37.428934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1173/2373] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:27:37.507813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e2c6-fa68-4a18-b23e-c0a15565b538 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.508242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e2c6-fa68-4a18-b23e-c0a15565b538 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.508617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9e2c6-fa68-4a18-b23e-c0a15565b538 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.510623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1201/2374] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:27:37.516509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7590a-b434-4497-8f09-76384b601d91 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.516743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7590a-b434-4497-8f09-76384b601d91 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.517061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7590a-b434-4497-8f09-76384b601d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.537099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0ad7590a-b434-4497-8f09-76384b601d91 None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:37.538629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ad7590a-b434-4497-8f09-76384b601d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:37.553980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:37.600636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1174/2375] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:27:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:37.613244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e2c6-fa68-4a18-b23e-c0a15565b538 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:37.615055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-03e9e2c6-fa68-4a18-b23e-c0a15565b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:37.629895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9e2c6-fa68-4a18-b23e-c0a15565b538 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:37.634669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44591c-6992-4018-ae22-4606cee69d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:37.634972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44591c-6992-4018-ae22-4606cee69d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.635148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44591c-6992-4018-ae22-4606cee69d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.635425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44591c-6992-4018-ae22-4606cee69d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.643845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44591c-6992-4018-ae22-4606cee69d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:37.645320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44591c-6992-4018-ae22-4606cee69d0a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:37.654250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1202/2376] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:27:37.748552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06b6b-8f20-4087-8e72-4a0aff54747f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.748823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06b6b-8f20-4087-8e72-4a0aff54747f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.749100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06b6b-8f20-4087-8e72-4a0aff54747f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.750567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1175/2377] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:27:37.757142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237088-ab7f-4d9e-bc46-42e61f25cd2f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.757490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237088-ab7f-4d9e-bc46-42e61f25cd2f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.757810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237088-ab7f-4d9e-bc46-42e61f25cd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.777406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a2237088-ab7f-4d9e-bc46-42e61f25cd2f None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:37.778552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a2237088-ab7f-4d9e-bc46-42e61f25cd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:37.788857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1203/2378] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:27:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:27:37.799553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac06b6b-8f20-4087-8e72-4a0aff54747f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:37.811541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac06b6b-8f20-4087-8e72-4a0aff54747f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:37.815300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:37.815956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:37.816241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:37.816509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:37.828831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:37.830357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:37.845172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1176/2379] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:27:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:27:43.676340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cdf2f-ccf0-4092-8ad3-4ba388fc5c19 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:43.676934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cdf2f-ccf0-4092-8ad3-4ba388fc5c19 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:43.677273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cdf2f-ccf0-4092-8ad3-4ba388fc5c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:43.708507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0a8cdf2f-ccf0-4092-8ad3-4ba388fc5c19 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:43.711070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0a8cdf2f-ccf0-4092-8ad3-4ba388fc5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:43.721365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1204/2380] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:43.735168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:27:43.747195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad26319-4a2d-4380-8858-4446622d8cfe service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:27:43.752450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11812-2a4a-492e-8867-55da079ff993 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:27:43.753247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11812-2a4a-492e-8867-55da079ff993 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:43.753624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11812-2a4a-492e-8867-55da079ff993 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:43.754058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11812-2a4a-492e-8867-55da079ff993 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:43.763826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11812-2a4a-492e-8867-55da079ff993 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:27:43.765519 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11812-2a4a-492e-8867-55da079ff993 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:27:43.776281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1177/2381] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:27:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:27:47.997151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74286123-bdd8-4226-b1e1-5e442e045201 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:27:47.998032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74286123-bdd8-4226-b1e1-5e442e045201 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:27:47.998185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74286123-bdd8-4226-b1e1-5e442e045201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:27:48.041291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-74286123-bdd8-4226-b1e1-5e442e045201 None None] MFA Rules not processed for user `471604cbdeba4f4fafbb1d88734fd18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:27:48.042670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-74286123-bdd8-4226-b1e1-5e442e045201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:27:48.128894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1205/2382] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:27:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:27:53.771982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=26 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:58.121271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=61 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:07.410553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:07.411584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:07.411584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:07.438537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] MFA Rules not processed for user `144457df5bd2420796f8f8d6bbce7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:07.440536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:07.514505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1178/2383] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:28:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:28:08.486666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c8e7-e884-412a-aaef-fbffd27d7796 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:08.487244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c8e7-e884-412a-aaef-fbffd27d7796 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:08.487329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c8e7-e884-412a-aaef-fbffd27d7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:08.532258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e774c8e7-e884-412a-aaef-fbffd27d7796 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:08.535012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e774c8e7-e884-412a-aaef-fbffd27d7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:08.552230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1206/2384] 10.222.0.61 () {58 vars in 967 bytes} [Fri May 27 03:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:28:08.571176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:28:08.594023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b95326-f465-43b1-9325-b8480a785c78 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:28:08.603398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:28:08.604466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:08.604928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:08.605391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:08.621629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:28:08.625253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:28:08.643497 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1179/2385] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:28:18.520720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:18.636115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=31 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:21.087160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a160-c422-4d34-a0df-4e8de0274509 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:21.087824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a160-c422-4d34-a0df-4e8de0274509 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:21.087824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a160-c422-4d34-a0df-4e8de0274509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:21.109607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-40d0a160-c422-4d34-a0df-4e8de0274509 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:21.111711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-40d0a160-c422-4d34-a0df-4e8de0274509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:21.123816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1207/2386] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:28:21.139172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:28:21.161880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d49bd1-8b13-40c2-a2d6-b53cccedbf1f service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:28:21.171979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:28:21.173106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:21.173598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:21.174116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:21.190908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:28:21.194782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:28:21.215113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1180/2387] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:28:26.489613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eb613-c6a1-40ff-b030-67aacf02ed55 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:26.490606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eb613-c6a1-40ff-b030-67aacf02ed55 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:26.490606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2eb613-c6a1-40ff-b030-67aacf02ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:26.518420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9a2eb613-c6a1-40ff-b030-67aacf02ed55 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:26.519959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9a2eb613-c6a1-40ff-b030-67aacf02ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:26.530333 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1208/2388] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:28:26.550206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:28:26.571506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6ba1f-f958-4636-87ec-c0593225d4f4 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:28:26.581798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:28:26.582973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:26.583490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:26.583982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:26.600773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:28:26.604008 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:28:26.623872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1181/2389] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:28:30.667229 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6640c-38c5-4e65-8753-3794c5945371 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:30.667770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6640c-38c5-4e65-8753-3794c5945371 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:30.668262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6640c-38c5-4e65-8753-3794c5945371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:30.690475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-aaf6640c-38c5-4e65-8753-3794c5945371 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:30.691808 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aaf6640c-38c5-4e65-8753-3794c5945371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:30.701713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1209/2390] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:28:30.723577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:28:30.743675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d4251-8b8e-4ba0-bce1-836d1ea4240d service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:28:30.750371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:28:30.751107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:30.751437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:30.751746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:30.763340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:28:30.765674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:28:30.777726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1182/2391] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:28:34.898191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b8c87-f34f-4c5e-bde6-fa67be2cda82 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:34.899148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b8c87-f34f-4c5e-bde6-fa67be2cda82 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:34.899488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b8c87-f34f-4c5e-bde6-fa67be2cda82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:34.938747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ee8b8c87-f34f-4c5e-bde6-fa67be2cda82 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:34.941651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ee8b8c87-f34f-4c5e-bde6-fa67be2cda82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:34.958895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1210/2392] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:28:35.000093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:28:35.016456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024c582-fa0a-4810-83ed-43bb3b2321f3 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:28:35.024966 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:28:35.025919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:35.026366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:35.026770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:35.042561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:28:35.045183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:28:35.064859 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1183/2393] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:28:39.172443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dd148-a42c-4cae-a987-00f2f23422d8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:39.173755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dd148-a42c-4cae-a987-00f2f23422d8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:39.174257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dd148-a42c-4cae-a987-00f2f23422d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:39.204401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0c6dd148-a42c-4cae-a987-00f2f23422d8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:39.206928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0c6dd148-a42c-4cae-a987-00f2f23422d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:39.220388 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1211/2394] 10.222.0.53 () {58 vars in 1016 bytes} [Fri May 27 03:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:28:39.240838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:28:39.253318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18772b0-5aa1-46ec-aeb5-78fa74f00468 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:28:39.259763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:28:39.260445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:39.260727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:39.260998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:39.272477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:28:39.274453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:28:39.286410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1184/2395] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:28:46.190577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:28:46.191221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:28:46.191536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:28:46.223073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] MFA Rules not processed for user `4a9445ed7a4645af8e578d797e7900da`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:28:46.225424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:28:46.342965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1212/2396] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:28:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:28:49.280909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=30 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:56.330168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=40 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:15.222744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:15.225105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:15.247572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752fdcd-ba04-44a7-b86e-43d3a09f9108 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:15.253237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:15.254239 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.254618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.254956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] PATH_INFO: `/v3/users/471604cbdeba4f4fafbb1d88734fd18f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.256387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471604cbdeba4f4fafbb1d88734fd18f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:15.258498 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:15.325791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471604cbdeba4f4fafbb1d88734fd18f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.341125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471604cbdeba4f4fafbb1d88734fd18f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.350942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471604cbdeba4f4fafbb1d88734fd18f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.351675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471604cbdeba4f4fafbb1d88734fd18f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.360332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a6c2d2a-8133-4513-af04-93ade93f6388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471604cbdeba4f4fafbb1d88734fd18f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.367390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1185/2397] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:29:15 2022] DELETE /identity/v3/users/471604cbdeba4f4fafbb1d88734fd18f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:29:15.573513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:15.589626 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddbda4-2c84-407e-9f9f-df1dfaefb329 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:15.657367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:15.658291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.658580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.658841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] PATH_INFO: `/v3/projects/c8639e94db83484db062e3b4a1120a39` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.660161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8639e94db83484db062e3b4a1120a39)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:15.662190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:15.717454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8639e94db83484db062e3b4a1120a39', 'request_id': 'req-847f1cfd-286b-4564-b07f-87ba284bc12d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.725095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8639e94db83484db062e3b4a1120a39', 'request_id': 'req-847f1cfd-286b-4564-b07f-87ba284bc12d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.731167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8639e94db83484db062e3b4a1120a39', 'request_id': 'req-847f1cfd-286b-4564-b07f-87ba284bc12d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.744793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] The token cache is being invalidate because project c8639e94db83484db062e3b4a1120a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:29:15.745251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.746019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-847f1cfd-286b-4564-b07f-87ba284bc12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:29:15.747630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1213/2398] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:29:15 2022] DELETE /identity/v3/projects/c8639e94db83484db062e3b4a1120a39 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:29:15.753029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.753349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.753645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.774070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:15.775546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:15.848686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1186/2399] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:29:15.856915 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.857255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.857577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.878406 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:15.879733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:15.888327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1214/2400] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:15.893356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:15.903925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0afa0b-fac2-4d74-83c5-876e896ec3a9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:15.909594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:15.910323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.910613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.910885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.911629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:29:15.911940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:15.913606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:15.930740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1187/2401] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:29:15.936156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:15.945908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bb16d-946c-4471-b895-268bc82434c0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:15.951060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:15.951777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.952102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.952419 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.953170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:15.955737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:15.986187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1215/2402] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:29:15 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:29:15.990601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:16.002234 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29ee1-118c-4dfd-a795-a64a6c8fd602 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:16.064661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:16.065339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.065622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.065897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.066702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:16.068721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:16.076579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:16.093695 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1188/2403] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:29:15 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:29:16.098461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:16.109866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a9751-60f7-476f-ac6a-e404a118bd81 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:16.117577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:16.118351 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.118640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.118918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.119662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:16.121336 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:16.134756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1216/2404] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:29:16.138957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:16.150683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d70fc3-69a2-4e98-a4ae-4747339d5d38 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:16.155922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692930-7336-4826-9de1-d5f65215b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:16.156607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692930-7336-4826-9de1-d5f65215b486 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.156927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692930-7336-4826-9de1-d5f65215b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.157206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692930-7336-4826-9de1-d5f65215b486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.157943 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692930-7336-4826-9de1-d5f65215b486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:16.159679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692930-7336-4826-9de1-d5f65215b486 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:16.172221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1189/2405] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:29:16.176941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:16.187732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cabdbf-c9da-46d4-8136-4474876151bb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:16.193776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:16.194755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.195038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.195318 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] PATH_INFO: `/v3/projects/f5455e547bbd4c8a91a924c0b687a655/users/1cbfa6d00f124bd581fbbe67b91c78e2/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.220074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5455e547bbd4c8a91a924c0b687a655, user_id=1cbfa6d00f124bd581fbbe67b91c78e2, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:16.222859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:16.237892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1217/2406] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:29:16 2022] PUT /identity/v3/projects/f5455e547bbd4c8a91a924c0b687a655/users/1cbfa6d00f124bd581fbbe67b91c78e2/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:29:16.244358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.245088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.245388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.276283 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:16.278463 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:16.388454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1190/2407] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:16.399535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:16.401375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:16.435016 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:16.470080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fb2da-efc0-48f9-ba46-e59bada8f6e3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:16.473896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:16.474602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.474882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.475155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.485323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:16.486830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:16.498177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1218/2408] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:29:19.629631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:19.634315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:19.780316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2423c-4767-40ff-b4f0-bc8272f783d0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:19.787988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:19.789674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:19.789989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:19.790858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:19.793195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:19.967307 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:19.972113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c7c83-21d0-456c-a0cc-b16fc80b21c2 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:19.995259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1191/2409] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:20.314240 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:20.315933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:20.413208 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53943a05-8b20-4a99-8fce-c9660018acbd service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:20.420696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:20.421852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:20.422942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:20.423443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:20.426139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:20.445196 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:20.447185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:20.463682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1219/2410] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:21.973474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:21.974117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:21.974117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.013097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] MFA Rules not processed for user `1cbfa6d00f124bd581fbbe67b91c78e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:22.014836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:22.019441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:22.128876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1192/2411] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:22.134564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:22.158231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976fd84-7b9b-411b-8407-4433733798b8 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:22.167303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:22.168398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:22.168870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:22.169313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.170332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:22.184558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:22.238367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1220/2412] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:29:22 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:29:22.239654 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:22.252718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5dab-fda3-4e9b-944b-1d80760b885e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:22.340430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:22.341161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:22.341451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:22.341731 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.342493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:22.344579 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:22.378945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1193/2413] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:29:22 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:29:22.383409 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:22.396065 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7252-0721-471d-87a4-71e2a6dddffb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:22.401756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:22.402597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:22.402952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:22.403293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.404139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:22.405861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:22.419242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1221/2414] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:29:22.431523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:22.437396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03e5c-44ec-49f3-aed2-74bbdb8d21dc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:22.443205 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:22.444141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:22.444425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:22.444703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] PATH_INFO: `/v3/projects/756b06bdb90243f9a53bc78f4f15641d/users/8630c22343b24e409deb01bd53559b31/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.462849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756b06bdb90243f9a53bc78f4f15641d, user_id=8630c22343b24e409deb01bd53559b31, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:22.465837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:22.488380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1194/2415] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:29:22 2022] PUT /identity/v3/projects/756b06bdb90243f9a53bc78f4f15641d/users/8630c22343b24e409deb01bd53559b31/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:29:22.489883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:22.502828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2faa50-51cc-4a47-af30-c40f325c9727 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:22.588169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:22.589000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:22.589294 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:22.589581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.590380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:22.592080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:22.607142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1222/2416] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:29:22.608740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:22.628626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bcd89-aaf6-45b9-93f5-b269b0544d82 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:22.635875 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9bd5-911a-47e4-906f-bd87539e3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:22.636796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9bd5-911a-47e4-906f-bd87539e3553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:22.637112 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9bd5-911a-47e4-906f-bd87539e3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:22.637416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9bd5-911a-47e4-906f-bd87539e3553 admin admin] PATH_INFO: `/v3/projects/756b06bdb90243f9a53bc78f4f15641d/users/8630c22343b24e409deb01bd53559b31/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:22.639570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9bd5-911a-47e4-906f-bd87539e3553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756b06bdb90243f9a53bc78f4f15641d, user_id=8630c22343b24e409deb01bd53559b31, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:22.642756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9bd5-911a-47e4-906f-bd87539e3553 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:22.655905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1195/2417] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:29:22 2022] PUT /identity/v3/projects/756b06bdb90243f9a53bc78f4f15641d/users/8630c22343b24e409deb01bd53559b31/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:29:23.569812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:23.696458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:23.742789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1807-b6fc-480f-a9b2-cebb7942ea08 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:23.857018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:23.858989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:23.858989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:23.859959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:23.864322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:24.053718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:24.056160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:24.093233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1223/2418] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:31.540940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19fb6-39f7-4583-a22c-94ff2ab08598 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:31.542679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19fb6-39f7-4583-a22c-94ff2ab08598 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:31.544452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19fb6-39f7-4583-a22c-94ff2ab08598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:31.605255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69e19fb6-39f7-4583-a22c-94ff2ab08598 None None] MFA Rules not processed for user `8630c22343b24e409deb01bd53559b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:31.607585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69e19fb6-39f7-4583-a22c-94ff2ab08598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:31.691400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:31.728539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1196/2419] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:31.747476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:31.762701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e887b0-4e0c-447b-9a89-190e5c9cb8ac service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:31.770851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:31.771982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:31.772386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:31.772768 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:31.865015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:31.868637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:31.885265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1224/2420] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:29:32.020099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:32.020598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:32.021073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:32.076773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] MFA Rules not processed for user `1b6e4c96f7054aaeaafebfecdd960467`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:32.079930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:32.220621 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1197/2421] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:32.729227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:32.743452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b6c7c-4f4e-40d8-8363-af4edaff7d92 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:32.748271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:32.749380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:32.749858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:32.750346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:32.752944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:32.764676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:32.766397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629bb7c-6bd5-4edb-9abb-dc7d7de5c570 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:32.776448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1225/2422] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:33.240197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:33.242701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:33.346458 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f948e-cee0-48e5-9cf5-9c56cff7e79f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:33.354347 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:33.355403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:33.355870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:33.356337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:33.358528 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:33.377506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:33.380028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:33.386103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:33.387486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:33.387890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:33.392325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1198/2423] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:33.412989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] MFA Rules not processed for user `1cbfa6d00f124bd581fbbe67b91c78e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:33.414495 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:33.424485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1226/2424] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:29:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:29:35.902046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:35.903645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:35.917846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a20c-3fea-4780-9c14-6aaa4aa67aa9 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:35.925397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:35.926558 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:35.927297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:35.928050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:35.932097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:35.946832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:35.948800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:35.960160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1199/2425] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:37.094267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:37.141136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0849-afcc-4a88-a844-0f1bc07de123 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:37.161067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:37.162198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:37.162801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:37.163390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:37.167097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:37.194641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:37.200775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:37.214502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:37.231256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1227/2426] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:29:43.774308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:43.808834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88a55-c9d2-4f76-933e-b82274cb4e5d service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:43.823040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:43.824749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:43.825567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:43.826180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:43.832425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:43.853060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:43.854879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:43.872456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1200/2427] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:47.224558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:48.286628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:48.288403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:48.303644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed53a4c-b422-4cfd-bf84-3426882ed052 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:48.309920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:48.310637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:48.310923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:48.311713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:48.313750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:48.336729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:48.338551 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:48.351211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1228/2428] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:52.663059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:52.672770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd4c0a-40d0-4d74-92a8-031dcc807ac0 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:52.677028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:52.677686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:52.677997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:52.678265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:52.680079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:52.691589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:52.693765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:52.705382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1201/2429] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:29:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:29:58.345720 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:01.581822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:01.697815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf3111-6e3f-459d-90a2-1fb30088586d service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:01.704639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:01.705396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:01.705686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:01.706040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:01.708138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:01.833295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:01.841106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e4e8-249f-436e-941d-23f4dfd3f246 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:01.883245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1229/2430] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:02.700828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=83 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:10.079746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:10.093171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e2279-4db7-4647-aed7-aaf277f004ff service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:10.103060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:10.107797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:10.108679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:10.109156 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:10.128284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:10.131132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:10.161876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1202/2431] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:11.866699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=48 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:20.079835 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:20.080509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:20.080604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:20.100303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] MFA Rules not processed for user `144457df5bd2420796f8f8d6bbce7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:20.101550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:20.141671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:20.187913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1230/2432] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:25.354885 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:25.371010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec52d32-01de-4f49-84e3-4f2ad1d7631d service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:25.384744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:25.385945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:25.386466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:25.387511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:25.390257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:25.508733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:25.512617 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:25.533049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1203/2433] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:28.674668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:28.688597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ce21-9ff2-4865-b5aa-e91b65d65fe0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:28.702552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:28.704309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:28.705186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:28.705788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:28.709158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:28.723420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:28.725089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:28.737518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1231/2434] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:30.846926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:30.848448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:30.872667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab6a64-0e0b-46be-b91e-43070d71f424 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:30.878910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:30.880065 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:30.880789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:30.881067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] PATH_INFO: `/v3/users/4a9445ed7a4645af8e578d797e7900da` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:30.882493 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9445ed7a4645af8e578d797e7900da)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:30.884670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:30.960131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9445ed7a4645af8e578d797e7900da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:30.976217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9445ed7a4645af8e578d797e7900da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:30.986026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9445ed7a4645af8e578d797e7900da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:30.986698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9445ed7a4645af8e578d797e7900da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:30.994757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5d8f0f9e-c9ab-44a4-a294-d6c5655a5055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9445ed7a4645af8e578d797e7900da'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:31.001880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1204/2435] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:30 2022] DELETE /identity/v3/users/4a9445ed7a4645af8e578d797e7900da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:31.253119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:31.271353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb2ef-a1bf-48f5-9981-92893fd64f9c service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:31.358353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:31.359568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.359914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.360263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] PATH_INFO: `/v3/projects/4cc2f3a125874013802139b93f4670ef` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.361746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc2f3a125874013802139b93f4670ef)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:31.363797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:31.430791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc2f3a125874013802139b93f4670ef', 'request_id': 'req-3363d7fe-7732-4d2b-b763-d0f38a8e204a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:31.442961 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc2f3a125874013802139b93f4670ef', 'request_id': 'req-3363d7fe-7732-4d2b-b763-d0f38a8e204a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:31.453469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc2f3a125874013802139b93f4670ef', 'request_id': 'req-3363d7fe-7732-4d2b-b763-d0f38a8e204a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:31.469477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] The token cache is being invalidate because project 4cc2f3a125874013802139b93f4670ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:31.469933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:31.470809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3363d7fe-7732-4d2b-b763-d0f38a8e204a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:31.472674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1232/2436] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:31 2022] DELETE /identity/v3/projects/4cc2f3a125874013802139b93f4670ef => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:31.477884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.478190 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.478470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.498581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:31.500801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:31.600303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1205/2437] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:31.609913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.610364 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.610684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.632087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:31.633397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:31.642188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1233/2438] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:31.648955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:31.666802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c81b6-c2c2-4297-ba89-8fcebf8b43a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:31.674326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:31.675158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.675563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.675930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.676777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:30:31.677187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:31.678964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:31.680886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:31.698247 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1206/2439] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:30:31.702576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:31.712764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912efcdd-8f7c-4bd0-8070-c7fe30846b2a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:31.717798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:31.718574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.718858 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.719144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.719855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:31.721822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:31.738100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:31.766564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1234/2440] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:31 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:31.772862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:31.791786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8865f9-a551-4404-897f-016e609d2d1b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:31.874361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:31.875514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.875514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.875876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.876735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:31.878840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:31.901988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1207/2441] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:31 2022] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:31.909398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:31.928558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492b06-26e7-44c9-8e6d-808727619dab admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:31.936412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:31.937571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.938113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.938597 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.939941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:31.943115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:31.960709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1235/2442] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:31.966710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:31.977783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc959c42-5f38-44ef-8a15-3742fc61c600 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:31.983634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b2874-608f-4cb0-8fd2-6e3e1c280859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:31.984351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b2874-608f-4cb0-8fd2-6e3e1c280859 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:31.984631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b2874-608f-4cb0-8fd2-6e3e1c280859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:31.984907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b2874-608f-4cb0-8fd2-6e3e1c280859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:31.985661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b2874-608f-4cb0-8fd2-6e3e1c280859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:31.987371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b2874-608f-4cb0-8fd2-6e3e1c280859 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:32.002879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1208/2443] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:30:32.007407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:32.020041 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b85874-3046-4d4a-a963-01f85cb8c7c6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:32.025769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:32.026728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.027009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.027785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] PATH_INFO: `/v3/projects/380a1b32bcf84e979bd54fd99994145b/users/49d3cdba4b1343d1b22bbc25f5fa8bba/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.048586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] RBAC: Authorizing `identity:create_grant(project_id=380a1b32bcf84e979bd54fd99994145b, user_id=49d3cdba4b1343d1b22bbc25f5fa8bba, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:32.054282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:32.076217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1236/2444] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:32 2022] PUT /identity/v3/projects/380a1b32bcf84e979bd54fd99994145b/users/49d3cdba4b1343d1b22bbc25f5fa8bba/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:32.082990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57950-a081-463f-826c-d475b85ba3e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.083390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57950-a081-463f-826c-d475b85ba3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.083827 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57950-a081-463f-826c-d475b85ba3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.105150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-08d57950-a081-463f-826c-d475b85ba3e2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:32.107329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-08d57950-a081-463f-826c-d475b85ba3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:32.184998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1209/2445] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:32.199759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:32.201830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:32.296620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf2401-a6eb-47ec-bac7-2d9c020b775f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:32.303087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:32.304269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.304756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.305242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.320078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:32.321836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:32.333155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1237/2446] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:30:33.229818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.230880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.230880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.280445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] MFA Rules not processed for user `49d3cdba4b1343d1b22bbc25f5fa8bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:33.282782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:33.402944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1210/2447] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:33.407517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.419244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f06e6-7acc-426e-95db-6770101895cb service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.425123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.425818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.426149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.426433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.427165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.429179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.483166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1238/2448] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:33 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:33.491387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.512450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:33.531176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66ac8-5b02-4fe0-a1b8-30ccb670ced2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.622324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.623187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.623624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.624026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.625248 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.628287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.656316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1211/2449] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:33 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:33.661022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.676682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65976032-d3de-47e0-8450-cda833ecbd71 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.683340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.684814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.685193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.685607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.686561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.688827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.706441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1239/2450] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:30:33.711231 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.723394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a56eba-257a-4851-bc16-e96c8515bd1a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.728918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.730066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.730864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.731147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] PATH_INFO: `/v3/projects/3b9732a8e475470695d35e4b7f5c47bd/users/8b530e3d4c5c491591a72ff7c84a62c5/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.751014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9732a8e475470695d35e4b7f5c47bd, user_id=8b530e3d4c5c491591a72ff7c84a62c5, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.754105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.769759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1212/2451] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:33 2022] PUT /identity/v3/projects/3b9732a8e475470695d35e4b7f5c47bd/users/8b530e3d4c5c491591a72ff7c84a62c5/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:33.773953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.785732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433569a-2dba-4d48-ae4e-81336620dd87 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.866794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e4b3-f00d-4d13-9c03-b31afd95a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.867767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e4b3-f00d-4d13-9c03-b31afd95a573 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.868224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e4b3-f00d-4d13-9c03-b31afd95a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.868502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e4b3-f00d-4d13-9c03-b31afd95a573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.869251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6e4b3-f00d-4d13-9c03-b31afd95a573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.871524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6e4b3-f00d-4d13-9c03-b31afd95a573 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.883456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1240/2452] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:33.888026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.901367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6c32-40d9-40e3-93b5-f10098a6416c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.906874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.907894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.908209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.908484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] PATH_INFO: `/v3/projects/3b9732a8e475470695d35e4b7f5c47bd/users/8b530e3d4c5c491591a72ff7c84a62c5/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.910806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9732a8e475470695d35e4b7f5c47bd, user_id=8b530e3d4c5c491591a72ff7c84a62c5, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.913594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.930046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1213/2453] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:33 2022] PUT /identity/v3/projects/3b9732a8e475470695d35e4b7f5c47bd/users/8b530e3d4c5c491591a72ff7c84a62c5/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:34.822652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:34.823212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:34.823533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:34.868938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] MFA Rules not processed for user `8b530e3d4c5c491591a72ff7c84a62c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:34.870993 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:34.880787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:34.999459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1241/2454] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:35.737836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:35.742623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:35.918783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d725ab5-fb7e-4da3-aad1-0a59b5254779 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:35.929484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:35.930196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:35.930635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:35.931017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:35.936099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:35.961149 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:35.964162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:35.985351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1214/2455] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:30:36.789746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:36.908817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f564a55-bfd6-4147-bc89-39e3ccf01e05 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:36.922766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:36.924291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:36.924786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:36.925200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] PATH_INFO: `/v3/users/49d3cdba4b1343d1b22bbc25f5fa8bba` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:36.927157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d3cdba4b1343d1b22bbc25f5fa8bba)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:36.930543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:37.032026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d3cdba4b1343d1b22bbc25f5fa8bba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.033012 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d3cdba4b1343d1b22bbc25f5fa8bba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.043330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d3cdba4b1343d1b22bbc25f5fa8bba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.053854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d3cdba4b1343d1b22bbc25f5fa8bba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.075017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d3cdba4b1343d1b22bbc25f5fa8bba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.083308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1242/2456] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:36 2022] DELETE /identity/v3/users/49d3cdba4b1343d1b22bbc25f5fa8bba => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:37.357688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:37.383614 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9defbe6-216d-4987-a768-d7e8b2297098 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:37.482557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:37.534345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:37.537260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:37.537599 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:37.537883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] PATH_INFO: `/v3/projects/380a1b32bcf84e979bd54fd99994145b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:37.539441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380a1b32bcf84e979bd54fd99994145b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:37.545075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:37.641855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380a1b32bcf84e979bd54fd99994145b', 'request_id': 'req-054610e4-d383-4c2a-be95-9c2f097454f5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.652873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380a1b32bcf84e979bd54fd99994145b', 'request_id': 'req-054610e4-d383-4c2a-be95-9c2f097454f5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.662323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380a1b32bcf84e979bd54fd99994145b', 'request_id': 'req-054610e4-d383-4c2a-be95-9c2f097454f5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.680673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] The token cache is being invalidate because project 380a1b32bcf84e979bd54fd99994145b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:37.681030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.681756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.683878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1215/2457] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:37 2022] DELETE /identity/v3/projects/380a1b32bcf84e979bd54fd99994145b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:37.688367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:37.691093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:37.725229 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb987e-a901-4616-8f37-56d6f9223984 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:37.760847 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:37.860668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:37.861705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:37.862145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:37.862483 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] PATH_INFO: `/v3/users/8b530e3d4c5c491591a72ff7c84a62c5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:37.864115 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b530e3d4c5c491591a72ff7c84a62c5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:37.866262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:37.949046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b530e3d4c5c491591a72ff7c84a62c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.949810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b530e3d4c5c491591a72ff7c84a62c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.960706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b530e3d4c5c491591a72ff7c84a62c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.974029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b530e3d4c5c491591a72ff7c84a62c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:37.998818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a7165728-f5a8-4d02-a222-76604de14f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b530e3d4c5c491591a72ff7c84a62c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:38.017519 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1243/2458] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:37 2022] DELETE /identity/v3/users/8b530e3d4c5c491591a72ff7c84a62c5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:38.366552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:38.371086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:38.395098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054610e4-d383-4c2a-be95-9c2f097454f5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:38.560934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:38.562940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:38.563422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:38.563856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] PATH_INFO: `/v3/projects/3b9732a8e475470695d35e4b7f5c47bd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:38.566524 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9732a8e475470695d35e4b7f5c47bd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:38.569886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:38.659481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9732a8e475470695d35e4b7f5c47bd', 'request_id': 'req-8b531de6-e2ff-40f1-a050-d76d31711ea6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:38.666814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9732a8e475470695d35e4b7f5c47bd', 'request_id': 'req-8b531de6-e2ff-40f1-a050-d76d31711ea6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:38.674846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9732a8e475470695d35e4b7f5c47bd', 'request_id': 'req-8b531de6-e2ff-40f1-a050-d76d31711ea6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:38.702573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] The token cache is being invalidate because project 3b9732a8e475470695d35e4b7f5c47bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:38.702994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:38.704444 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b531de6-e2ff-40f1-a050-d76d31711ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:38.707374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1216/2459] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:38 2022] DELETE /identity/v3/projects/3b9732a8e475470695d35e4b7f5c47bd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:38.714442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:38.714732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:38.716853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:38.749875 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:38.752345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:38.884497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1244/2460] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:38.897789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:38.898720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:38.900756 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:38.911890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:38.943070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:38.945271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:38.961537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1217/2461] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:38.974198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:38.992034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b5cf9-f65d-424d-bb80-81eb7a9b1c58 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.002002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.003510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.003963 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.004623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.005904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:30:39.006565 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.009452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.029906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1245/2462] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:30:39.035466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.048583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bae1c8-85df-4c28-b26f-8fe66aef0b65 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.056472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.057862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.058306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.058672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.059514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.062381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.108609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1218/2463] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:39 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:39.115330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.138793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5c528-cd6e-41ee-b92e-248d286d270a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.178358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:39.232930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.234021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.234491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.234944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.235972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.239426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.268554 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1246/2464] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:39 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:39.275059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.294245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfa2f3-0e1d-417c-82d5-dcf9a3c9f5f4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.302513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.303223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.303506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.303888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.304920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.306642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.328973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1219/2465] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:39.333791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.346703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86316e-a763-4e0e-b049-7237fec62c89 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.352393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36291f-c2d5-45a4-91a1-ba96c8fc0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.353085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36291f-c2d5-45a4-91a1-ba96c8fc0b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.353488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36291f-c2d5-45a4-91a1-ba96c8fc0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.353658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36291f-c2d5-45a4-91a1-ba96c8fc0b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.354487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36291f-c2d5-45a4-91a1-ba96c8fc0b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.356205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36291f-c2d5-45a4-91a1-ba96c8fc0b40 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.373536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1247/2466] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:39.380442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.399407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f775c8-b28e-46a0-ab85-0197957ba28a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.409796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.411019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.411478 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.411863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] PATH_INFO: `/v3/projects/6c23e1e1af6649a59146630a003e484a/users/ed1117b3991f4a299de628af146c87a6/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.434105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c23e1e1af6649a59146630a003e484a, user_id=ed1117b3991f4a299de628af146c87a6, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.438015 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.456733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1220/2467] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:39 2022] PUT /identity/v3/projects/6c23e1e1af6649a59146630a003e484a/users/ed1117b3991f4a299de628af146c87a6/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:39.468428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.468859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.469231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.519036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] MFA Rules not processed for user `ed1117b3991f4a299de628af146c87a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:39.520349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:39.633950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1248/2468] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:39.639244 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.729360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090a1c2-778b-4f27-94d9-113931317e8a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.736604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.738306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.738813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.739325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.740704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.744611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.783421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1221/2469] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:39 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:39.787674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.800109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e5782-abd0-44bf-82aa-37d52f2552c5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.881374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.882605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.883118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.883647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.884994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.888910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.919668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1249/2470] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:39 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:39.925262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.938657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcaee3-e76e-4894-9543-2c565edfac0a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.944821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.946165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.946453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.946730 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:39.947480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:39.949148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:39.967060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1222/2471] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:30:39.972371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:39.985263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f581d1-ccc8-4e12-8922-e9fea23fafd9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:39.992959 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:39.994517 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:39.994996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:39.996006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] PATH_INFO: `/v3/projects/847f56ed189a4231880a66ffa7cc32fa/users/9d4ec479663e4f52abb3e1449b18c635/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:40.017164 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847f56ed189a4231880a66ffa7cc32fa, user_id=9d4ec479663e4f52abb3e1449b18c635, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:40.020050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:40.039521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:40.049268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1250/2472] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:39 2022] PUT /identity/v3/projects/847f56ed189a4231880a66ffa7cc32fa/users/9d4ec479663e4f52abb3e1449b18c635/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:40.054919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:40.069132 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa0a5-9f86-4041-967a-4cb83f490aec admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:40.149355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dd688-c166-4277-83a6-7744db868c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:40.150402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dd688-c166-4277-83a6-7744db868c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:40.150871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dd688-c166-4277-83a6-7744db868c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:40.151211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dd688-c166-4277-83a6-7744db868c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:40.152626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6dd688-c166-4277-83a6-7744db868c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:40.154785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6dd688-c166-4277-83a6-7744db868c13 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:40.169280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1223/2473] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:40.173822 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:40.186214 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3159a1-df80-4ef3-b995-68c589820011 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:40.192940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:40.194367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:40.194856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:40.195342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] PATH_INFO: `/v3/projects/847f56ed189a4231880a66ffa7cc32fa/users/9d4ec479663e4f52abb3e1449b18c635/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:40.199552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847f56ed189a4231880a66ffa7cc32fa, user_id=9d4ec479663e4f52abb3e1449b18c635, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:40.204719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:40.227290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1251/2474] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:40 2022] PUT /identity/v3/projects/847f56ed189a4231880a66ffa7cc32fa/users/9d4ec479663e4f52abb3e1449b18c635/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:40.249435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:40.249921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:40.250443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:40.283291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:40.298609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] MFA Rules not processed for user `9d4ec479663e4f52abb3e1449b18c635`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:40.300996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:40.434119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1224/2475] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:40.447173 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:40.449924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:40.544598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e4bf-6c75-4583-a28c-61347515e820 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:40.549945 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321764b-7a50-4077-9ac7-9305ca063dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:40.550672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321764b-7a50-4077-9ac7-9305ca063dab service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:40.550970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321764b-7a50-4077-9ac7-9305ca063dab service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:40.551226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321764b-7a50-4077-9ac7-9305ca063dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:40.562505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321764b-7a50-4077-9ac7-9305ca063dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:40.564003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321764b-7a50-4077-9ac7-9305ca063dab service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:40.576749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1252/2476] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:30:40.754117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:40.851547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c248-8f1d-42dd-b4a6-86e3210df8b3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:40.858555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:40.860174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:40.861285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:40.861285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] PATH_INFO: `/v3/users/ed1117b3991f4a299de628af146c87a6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:40.863563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1117b3991f4a299de628af146c87a6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:40.867576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:40.950148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1117b3991f4a299de628af146c87a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:40.968907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1117b3991f4a299de628af146c87a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:40.980481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1117b3991f4a299de628af146c87a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:40.981504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1117b3991f4a299de628af146c87a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:40.993992 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1117b3991f4a299de628af146c87a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:41.003062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1225/2477] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:40 2022] DELETE /identity/v3/users/ed1117b3991f4a299de628af146c87a6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:41.008397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:41.009198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:41.009363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:41.034422 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:41.036436 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:41.131622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1253/2478] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:41.145445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:41.147768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:41.173483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:41.232110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c5b62-d824-44ca-9aa6-9ede2fda2979 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:41.237569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:41.238618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:41.238805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:41.239147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:41.253908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:41.256074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:41.268593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1226/2479] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:41.654032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:41.654032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:41.673539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbbe73-dd67-4406-b21a-a539878c5af1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:41.684459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:41.686532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:41.687159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:41.687542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] PATH_INFO: `/v3/projects/6c23e1e1af6649a59146630a003e484a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:41.689588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c23e1e1af6649a59146630a003e484a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:41.692679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:41.767230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c23e1e1af6649a59146630a003e484a', 'request_id': 'req-1f967bec-2498-43c2-af61-29fdb55fcf2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:41.777809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c23e1e1af6649a59146630a003e484a', 'request_id': 'req-1f967bec-2498-43c2-af61-29fdb55fcf2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:41.786729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c23e1e1af6649a59146630a003e484a', 'request_id': 'req-1f967bec-2498-43c2-af61-29fdb55fcf2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:41.805548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] The token cache is being invalidate because project 6c23e1e1af6649a59146630a003e484a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:41.806031 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:41.807098 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:41.810386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1254/2480] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:41 2022] DELETE /identity/v3/projects/6c23e1e1af6649a59146630a003e484a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:41.815523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:41.830521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caf988-0e70-4ab2-82ed-ec21f794ee45 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:41.921387 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:41.922473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:41.924762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:41.925207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] PATH_INFO: `/v3/users/9d4ec479663e4f52abb3e1449b18c635` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:41.926968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4ec479663e4f52abb3e1449b18c635)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:41.932670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:42.019794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4ec479663e4f52abb3e1449b18c635'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.036638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4ec479663e4f52abb3e1449b18c635'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.046180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4ec479663e4f52abb3e1449b18c635'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.046991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4ec479663e4f52abb3e1449b18c635'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.058938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24ee6170-39b8-49d3-b892-6aed5c61df67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4ec479663e4f52abb3e1449b18c635'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.068185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1227/2481] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:41 2022] DELETE /identity/v3/users/9d4ec479663e4f52abb3e1449b18c635 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:42.420458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:42.422107 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:42.442755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f967bec-2498-43c2-af61-29fdb55fcf2e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:42.459178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:42.547991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:42.549473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:42.550119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:42.550508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] PATH_INFO: `/v3/projects/847f56ed189a4231880a66ffa7cc32fa` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:42.552748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847f56ed189a4231880a66ffa7cc32fa)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:42.554841 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:42.616941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847f56ed189a4231880a66ffa7cc32fa', 'request_id': 'req-cda9fa82-1b34-4573-bff3-abb69e4a7c43'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.627703 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847f56ed189a4231880a66ffa7cc32fa', 'request_id': 'req-cda9fa82-1b34-4573-bff3-abb69e4a7c43'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.639757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847f56ed189a4231880a66ffa7cc32fa', 'request_id': 'req-cda9fa82-1b34-4573-bff3-abb69e4a7c43'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.658466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] The token cache is being invalidate because project 847f56ed189a4231880a66ffa7cc32fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:42.659072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.659989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cda9fa82-1b34-4573-bff3-abb69e4a7c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:42.662755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1255/2482] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:42 2022] DELETE /identity/v3/projects/847f56ed189a4231880a66ffa7cc32fa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:42.669761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:42.670359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:42.670765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:42.698641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:42.700839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:42.764285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:42.812946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1228/2483] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:42.821777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:42.822084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:42.822484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:42.841528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:42.845994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:42.857991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1256/2484] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:42.863610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:42.875615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd85b6-a717-41bc-aea3-52a992f4569f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:42.880417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:42.881094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:42.881374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:42.881650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:42.882407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:30:42.882711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:42.884327 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:42.898014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1229/2485] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:30:42.902356 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:42.916293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef6c3-8c8e-4c07-8774-0f0a29425a11 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:42.925398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:42.926492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:42.926924 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:42.927348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:42.928502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:42.931444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:42.978156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1257/2486] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:42 2022] POST /identity/v3/projects => generated 407 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:30:42.981178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:42.996616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76414-c754-4747-9310-8e8bb0dc19c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.067434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.068398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.068683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.068955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.069683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.071968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.105407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1230/2487] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:42 2022] POST /identity/v3/users => generated 304 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:43.111159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.131742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aef24-3455-45e2-a8cd-285876d99af8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.140500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.141697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.142226 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.142741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.144153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.147355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.172342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1258/2488] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:43.173664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.185317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680a17-71c2-41bc-b596-3bbbe03fabf2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.190439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8b6f3-5368-43ce-af30-c53fbc12c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.191137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8b6f3-5368-43ce-af30-c53fbc12c2de admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.191419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8b6f3-5368-43ce-af30-c53fbc12c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.191698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8b6f3-5368-43ce-af30-c53fbc12c2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.192430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8b6f3-5368-43ce-af30-c53fbc12c2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.194097 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8b6f3-5368-43ce-af30-c53fbc12c2de admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.207081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1231/2489] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:30:43.212044 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.224149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c043e5-6a09-4fbd-bb93-e30fa9fdd653 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.229170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.230167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.230454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.230734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] PATH_INFO: `/v3/projects/c9d3291254374d1aa739b320f70c1441/users/79e359db78ac4a0f851c2407ec2cda47/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.250426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d3291254374d1aa739b320f70c1441, user_id=79e359db78ac4a0f851c2407ec2cda47, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.253376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.271067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1259/2490] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:43 2022] PUT /identity/v3/projects/c9d3291254374d1aa739b320f70c1441/users/79e359db78ac4a0f851c2407ec2cda47/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:43.284431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.285288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.285666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.336688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] MFA Rules not processed for user `79e359db78ac4a0f851c2407ec2cda47`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:43.338851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:43.446058 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1232/2491] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:43.451268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.517397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:43.553660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260258-3ee7-4daf-9fa8-10efb8b787e0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.561510 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.562541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.562916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.563283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.564125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.566552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.606157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1260/2492] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:43 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:43.609996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.621593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae38c44-a34d-478f-8414-313050f9e55a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.679855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:43.728237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.729264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.729671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.730098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.730911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.733284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.758898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1233/2493] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:43 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:30:43.764058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.787024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bea36c-81b4-416c-a490-b22b6e587575 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.794468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.795499 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.795976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.796454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.797680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.800219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.818602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1261/2494] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:43.825284 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.839958 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5b93-8f3b-4dc0-8227-4ae4dff05c64 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.845619 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.846645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.846931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.847209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] PATH_INFO: `/v3/projects/87c90d0541ca466785b61a4031467396/users/4faafd70291c447c86582de216e04a09/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.865578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c90d0541ca466785b61a4031467396, user_id=4faafd70291c447c86582de216e04a09, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.868400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:43.885378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1234/2495] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:43 2022] PUT /identity/v3/projects/87c90d0541ca466785b61a4031467396/users/4faafd70291c447c86582de216e04a09/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:43.890742 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:43.903241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4a2b-d040-4d3b-8ca1-e9dd23d4870d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:43.987996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6e5ba-da08-42fa-b1aa-2d1237471900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:43.988950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6e5ba-da08-42fa-b1aa-2d1237471900 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:43.989420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6e5ba-da08-42fa-b1aa-2d1237471900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:43.989842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6e5ba-da08-42fa-b1aa-2d1237471900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:43.990791 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6e5ba-da08-42fa-b1aa-2d1237471900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:43.993788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6e5ba-da08-42fa-b1aa-2d1237471900 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:44.016475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1262/2496] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:30:44.018223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:44.031950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133de65-eb61-4a4e-a5e0-e3568dc7d5cf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:44.038923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:44.039964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:44.040396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:44.040772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] PATH_INFO: `/v3/projects/87c90d0541ca466785b61a4031467396/users/4faafd70291c447c86582de216e04a09/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:44.043405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c90d0541ca466785b61a4031467396, user_id=4faafd70291c447c86582de216e04a09, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:44.046923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:44.062308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1235/2497] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:44 2022] PUT /identity/v3/projects/87c90d0541ca466785b61a4031467396/users/4faafd70291c447c86582de216e04a09/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:44.079518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:44.079811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:44.080084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:44.128560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] MFA Rules not processed for user `4faafd70291c447c86582de216e04a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:44.130614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:44.249816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1263/2498] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:44.268918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:44.271281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:44.380130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15ed4-35d3-4b3c-89ee-a02d2542cfa6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:44.386465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:44.387610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:44.388121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:44.388628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:44.405267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:44.408196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:44.427862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1236/2499] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:44.664713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:44.677778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b7e7-e41a-4914-9b1c-70a575ec4f84 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:44.683111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269e92-8d5e-424a-b3f6-dfc2c9e38971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:44.683859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269e92-8d5e-424a-b3f6-dfc2c9e38971 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:44.684145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269e92-8d5e-424a-b3f6-dfc2c9e38971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:44.684427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269e92-8d5e-424a-b3f6-dfc2c9e38971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:44.731335 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:44.761144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269e92-8d5e-424a-b3f6-dfc2c9e38971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:44.762748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269e92-8d5e-424a-b3f6-dfc2c9e38971 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:44.773218 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1264/2500] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:30:50.355086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:50.425809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b485e9-19ce-41f7-882d-24374125284c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:50.430843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:50.431846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:50.432238 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:50.432606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] PATH_INFO: `/v3/users/79e359db78ac4a0f851c2407ec2cda47` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:50.434031 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e359db78ac4a0f851c2407ec2cda47)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:50.436198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:50.478653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:50.498952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e359db78ac4a0f851c2407ec2cda47'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:50.513548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e359db78ac4a0f851c2407ec2cda47'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:50.522306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e359db78ac4a0f851c2407ec2cda47'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:50.523079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e359db78ac4a0f851c2407ec2cda47'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:50.532333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e359db78ac4a0f851c2407ec2cda47'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:50.538991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1237/2501] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:50 2022] DELETE /identity/v3/users/79e359db78ac4a0f851c2407ec2cda47 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:50.544647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:50.545350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:50.545350 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:50.566070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:50.567380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:50.642122 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1265/2502] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:50.652150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:50.653690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:50.720928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc055d-f361-4ee8-b65e-82b1ad0954e7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:50.724636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:50.725295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:50.725577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:50.725883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:50.735964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:50.737426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:50.748520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1238/2503] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:51.053666 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:51.055440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:51.071617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9677cc-ec9e-4593-9397-7de2a29b8c8a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:51.078090 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:51.079177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:51.079563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:51.079941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] PATH_INFO: `/v3/projects/c9d3291254374d1aa739b320f70c1441` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:51.081574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d3291254374d1aa739b320f70c1441)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:51.084290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:51.142827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d3291254374d1aa739b320f70c1441', 'request_id': 'req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.151056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d3291254374d1aa739b320f70c1441', 'request_id': 'req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.158238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d3291254374d1aa739b320f70c1441', 'request_id': 'req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.176457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] The token cache is being invalidate because project c9d3291254374d1aa739b320f70c1441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:51.176910 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.177623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.179361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1266/2504] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:51 2022] DELETE /identity/v3/projects/c9d3291254374d1aa739b320f70c1441 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:51.184517 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:51.196260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0abe-29b0-4046-b8a9-bccc46a04572 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:51.263286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:51.264168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:51.264447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:51.264715 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] PATH_INFO: `/v3/users/4faafd70291c447c86582de216e04a09` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:51.266014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4faafd70291c447c86582de216e04a09)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:51.268030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:51.323442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4faafd70291c447c86582de216e04a09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.328743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:51.340778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4faafd70291c447c86582de216e04a09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.353632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4faafd70291c447c86582de216e04a09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.354782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4faafd70291c447c86582de216e04a09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.364633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-acec83b5-5622-4888-85d8-ab473a94500b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4faafd70291c447c86582de216e04a09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.371807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1239/2505] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:51 2022] DELETE /identity/v3/users/4faafd70291c447c86582de216e04a09 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:51.691313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:51.692818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:51.710700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7eb28-7c8b-406c-bc30-d791bf46aa0a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:51.817032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:51.827018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:51.828114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:51.828921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:51.829186 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] PATH_INFO: `/v3/projects/87c90d0541ca466785b61a4031467396` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:51.830750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c90d0541ca466785b61a4031467396)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:51.832880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:51.895283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c90d0541ca466785b61a4031467396', 'request_id': 'req-676374b7-e0a8-4fcc-8161-a657aa96d716'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.906997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c90d0541ca466785b61a4031467396', 'request_id': 'req-676374b7-e0a8-4fcc-8161-a657aa96d716'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.918877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c90d0541ca466785b61a4031467396', 'request_id': 'req-676374b7-e0a8-4fcc-8161-a657aa96d716'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.941368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] The token cache is being invalidate because project 87c90d0541ca466785b61a4031467396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:51.941890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.943034 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-676374b7-e0a8-4fcc-8161-a657aa96d716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:51.946353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1267/2506] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:51 2022] DELETE /identity/v3/projects/87c90d0541ca466785b61a4031467396 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:51.953736 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:51.954109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:51.954432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:51.975745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:51.977025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:52.047566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1240/2507] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:52.055885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.056174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.056453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.077008 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:52.078301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:52.086700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1268/2508] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:52.091837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.102494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e65658-93f6-48a4-92e8-b684714fee2c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.108040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.108725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.109004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.109280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.110048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:30:52.110371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.112002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.127445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1241/2509] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:30:52.133673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.144219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a3a9d-9409-4b34-bdde-5316f6f3f81b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.149189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.149871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.150187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.150465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.151707 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.153905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.183303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1269/2510] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:52 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:52.188270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.201815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7f17-8436-456a-9cab-3c997b4b101b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.280964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.281604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.281886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.282192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.282894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.284950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.307468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1242/2511] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:52 2022] POST /identity/v3/users => generated 280 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:52.313187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.324569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdb68e-20eb-4b37-a9df-c68757bab347 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.329457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.330200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.330513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.330792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.331622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.333345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.347373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1270/2512] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:52.352364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.364506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec80270-e8ef-4cd7-b02a-6d41c43c9423 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.369765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f5eea-a6b1-4e1a-904e-4cc3e5fc1852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.370895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5eea-a6b1-4e1a-904e-4cc3e5fc1852 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.371265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5eea-a6b1-4e1a-904e-4cc3e5fc1852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.371674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5eea-a6b1-4e1a-904e-4cc3e5fc1852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.372487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f5eea-a6b1-4e1a-904e-4cc3e5fc1852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.374301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f5eea-a6b1-4e1a-904e-4cc3e5fc1852 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.386559 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1243/2513] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:30:52.391592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.403013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848878-ada2-4a6a-9852-478573d6ff2e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.408237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.409219 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.409541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.409855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] PATH_INFO: `/v3/projects/274e4f2554644e808e8d65a233845dad/users/e0d7cceb7bd240b484e194107e9b6556/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.427467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274e4f2554644e808e8d65a233845dad, user_id=e0d7cceb7bd240b484e194107e9b6556, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.430449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.446989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1271/2514] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:52 2022] PUT /identity/v3/projects/274e4f2554644e808e8d65a233845dad/users/e0d7cceb7bd240b484e194107e9b6556/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:52.458175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.458618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.458994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.490562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] MFA Rules not processed for user `e0d7cceb7bd240b484e194107e9b6556`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:52.491807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:52.526796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:52.601503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1244/2515] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:52.658392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.660189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:52.725748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ff76-75e2-48b5-ac6a-b08b260c0647 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.730668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d827d5-fc09-4a80-9565-e742255e7841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.731556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d827d5-fc09-4a80-9565-e742255e7841 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.731893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d827d5-fc09-4a80-9565-e742255e7841 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.732215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d827d5-fc09-4a80-9565-e742255e7841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.741802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d827d5-fc09-4a80-9565-e742255e7841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.743359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d827d5-fc09-4a80-9565-e742255e7841 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.753969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1272/2516] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:52.771893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:52.877811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f2446-f59b-4f2e-8d1c-8087059d371d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:52.882632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:52.883530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.883812 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.884086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] PATH_INFO: `/v3/users/e0d7cceb7bd240b484e194107e9b6556` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:52.885929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d7cceb7bd240b484e194107e9b6556)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:52.887967 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:52.947483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d7cceb7bd240b484e194107e9b6556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:52.962428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d7cceb7bd240b484e194107e9b6556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:52.971532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d7cceb7bd240b484e194107e9b6556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:52.972355 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d7cceb7bd240b484e194107e9b6556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:52.981328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d7cceb7bd240b484e194107e9b6556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:52.988099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1245/2517] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:52 2022] DELETE /identity/v3/users/e0d7cceb7bd240b484e194107e9b6556 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:52.992934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:52.993220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:52.993526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.012760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:53.014018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:53.036793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:53.096311 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1273/2518] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:53.107676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:53.109569 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:53.164114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:53.179152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1782bc-276f-4a63-a483-fd42c04c3961 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:53.183508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb5f45-43dd-4d48-be10-5203eadb4604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:53.184288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5f45-43dd-4d48-be10-5203eadb4604 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:53.184613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5f45-43dd-4d48-be10-5203eadb4604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:53.184930 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb5f45-43dd-4d48-be10-5203eadb4604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.197450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb5f45-43dd-4d48-be10-5203eadb4604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:53.199934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb5f45-43dd-4d48-be10-5203eadb4604 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:53.211914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1246/2519] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:53.525325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:53.528458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:53.548081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd074b8-5b85-4323-b3be-f08aef3046d7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:53.555332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:53.556507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:53.558032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:53.558032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] PATH_INFO: `/v3/projects/274e4f2554644e808e8d65a233845dad` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.559787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=274e4f2554644e808e8d65a233845dad)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:53.562244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:53.624360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274e4f2554644e808e8d65a233845dad', 'request_id': 'req-bb8fac7c-c045-4095-959a-03cddecfd71d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:53.631454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274e4f2554644e808e8d65a233845dad', 'request_id': 'req-bb8fac7c-c045-4095-959a-03cddecfd71d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:53.639070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274e4f2554644e808e8d65a233845dad', 'request_id': 'req-bb8fac7c-c045-4095-959a-03cddecfd71d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:53.653997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] The token cache is being invalidate because project 274e4f2554644e808e8d65a233845dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:53.654362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:53.654999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bb8fac7c-c045-4095-959a-03cddecfd71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:53.656637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1274/2520] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:53 2022] DELETE /identity/v3/projects/274e4f2554644e808e8d65a233845dad => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:53.661755 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:53.662686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:53.662686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.681612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:53.683469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:53.781293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1247/2521] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:53.790435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:53.791255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:53.791255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.811129 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:53.812361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:53.825017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1275/2522] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:53.829325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:53.845326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d61ae-5d1c-4b33-9641-507067c0d882 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:53.850503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:53.851202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:53.851490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:53.851763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.852520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:30:53.852832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:53.855182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:53.873484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1248/2523] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:30:53.878205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:53.889465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d5242-27c3-4d42-a9cb-893e0f220592 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:53.897411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:53.898130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:53.898415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:53.898686 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:53.899393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:53.904264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:53.937438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1276/2524] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:53 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:53.941806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:53.953821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7514359-98e9-411d-b36f-fa70f496b11c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.062606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.063302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.063592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.063865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.064582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.066591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.094955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1249/2525] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:53 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:54.100101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.114160 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458997f-b205-448a-8ee1-45eb13e074aa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.124760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.125463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.125743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.126086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.127043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.128704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.141849 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1277/2526] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:54.146939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.158180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67550dd0-c5b1-481c-a0aa-fe915302cd3f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.163108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05f63a-6ea7-41ea-bc98-1e5923e80a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.163793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05f63a-6ea7-41ea-bc98-1e5923e80a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.164254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05f63a-6ea7-41ea-bc98-1e5923e80a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.164542 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05f63a-6ea7-41ea-bc98-1e5923e80a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.166391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05f63a-6ea7-41ea-bc98-1e5923e80a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.168071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05f63a-6ea7-41ea-bc98-1e5923e80a17 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.188686 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1250/2527] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:54.197021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.208712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e24c03-c2b5-4715-afb7-8df4e2491fd0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.214424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.215343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.215629 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.215904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] PATH_INFO: `/v3/projects/de581d75540c4912b21317598ad19f2e/users/8ead598192be40f69bbd61609f81fc09/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.236926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de581d75540c4912b21317598ad19f2e, user_id=8ead598192be40f69bbd61609f81fc09, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.239784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.258612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1278/2528] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:54 2022] PUT /identity/v3/projects/de581d75540c4912b21317598ad19f2e/users/8ead598192be40f69bbd61609f81fc09/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:54.277384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.277718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.278174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.313646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] MFA Rules not processed for user `8ead598192be40f69bbd61609f81fc09`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:54.314926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:54.367422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:54.399465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1251/2529] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:54.405159 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.462636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:54.480284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6edd5-843d-4da8-900e-cd9c14bd64bb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.485763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.486538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.486821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.487093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.487804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.489794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.523812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1279/2530] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:54 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:54.529428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.540811 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898002e2-d5a5-4fe9-aef7-f9ed914e88a1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.611918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.612676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.613000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.613317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.614115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.616543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.640323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1252/2531] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:54 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:30:54.644697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.655585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983679cd-473f-4c2b-890b-d2f04bd6c2c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.661726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.662438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.662722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.662999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.663737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.665392 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.681020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1280/2532] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:54.686143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.697174 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b4ba-e404-4649-9f42-6960138c488b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.702302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.703423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.703748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.704027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] PATH_INFO: `/v3/projects/1d88209257c84316b9c355db3339ffc8/users/147110394cd64af0ad8dcfcd15774faa/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.726286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d88209257c84316b9c355db3339ffc8, user_id=147110394cd64af0ad8dcfcd15774faa, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.729457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.748810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1253/2533] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:54 2022] PUT /identity/v3/projects/1d88209257c84316b9c355db3339ffc8/users/147110394cd64af0ad8dcfcd15774faa/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:54.754998 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.766782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8a2e-1694-4f76-aed5-e0521227142b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.834894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87224-1f3c-48d3-8a2d-cf3f10dc7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.835650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87224-1f3c-48d3-8a2d-cf3f10dc7cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.835949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87224-1f3c-48d3-8a2d-cf3f10dc7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.836269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87224-1f3c-48d3-8a2d-cf3f10dc7cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.837049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87224-1f3c-48d3-8a2d-cf3f10dc7cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.838884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87224-1f3c-48d3-8a2d-cf3f10dc7cd1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.850367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1281/2534] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:54.855598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:54.868794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1506-3bb3-4c7f-a501-4fcfb1edb498 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:54.877432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:54.878980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.879484 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.879957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] PATH_INFO: `/v3/projects/1d88209257c84316b9c355db3339ffc8/users/147110394cd64af0ad8dcfcd15774faa/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.883596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d88209257c84316b9c355db3339ffc8, user_id=147110394cd64af0ad8dcfcd15774faa, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:54.888911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:54.907829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1254/2535] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:30:54 2022] PUT /identity/v3/projects/1d88209257c84316b9c355db3339ffc8/users/147110394cd64af0ad8dcfcd15774faa/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:54.927100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:54.927593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:54.928082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:54.975073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] MFA Rules not processed for user `147110394cd64af0ad8dcfcd15774faa`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:54.976405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:55.057593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1282/2536] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:55.070361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:55.072237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:55.137435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b7ee3-2d14-48c4-aeaa-e10068570ca9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:55.141237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59263d-726d-4827-8f64-845f3dbcd399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:55.141899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59263d-726d-4827-8f64-845f3dbcd399 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:55.142214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59263d-726d-4827-8f64-845f3dbcd399 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:55.142504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59263d-726d-4827-8f64-845f3dbcd399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:55.198545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:55.212856 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59263d-726d-4827-8f64-845f3dbcd399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:55.214909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59263d-726d-4827-8f64-845f3dbcd399 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:55.225025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1255/2537] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:57.901845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:57.988228 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:58.022818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb69fc5-07ff-4b8c-994e-3e4d4346b1cb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:58.031096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:58.032668 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:58.033178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:58.033682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] PATH_INFO: `/v3/users/8ead598192be40f69bbd61609f81fc09` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:58.035989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ead598192be40f69bbd61609f81fc09)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:58.039861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:58.116531 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ead598192be40f69bbd61609f81fc09'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.117610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ead598192be40f69bbd61609f81fc09'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.131344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ead598192be40f69bbd61609f81fc09'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.143223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ead598192be40f69bbd61609f81fc09'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.166797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ead598192be40f69bbd61609f81fc09'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.173806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1283/2538] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:57 2022] DELETE /identity/v3/users/8ead598192be40f69bbd61609f81fc09 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:58.178761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:58.179618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:58.179618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:58.198105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:58.199352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:58.287110 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1256/2539] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:58.299693 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:58.302467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:58.371347 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350e58-7196-425f-92b2-ea1da2ddc0b9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:58.376023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:58.376830 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:58.377191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:58.377709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:58.389794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:58.391193 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:58.402349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1284/2540] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:58.752155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:58.755145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:58.774914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b356-45f7-4575-bd1b-9ca1d06e1336 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:58.783107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:58.784544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:58.784878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:58.785198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] PATH_INFO: `/v3/projects/de581d75540c4912b21317598ad19f2e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:58.786797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de581d75540c4912b21317598ad19f2e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:58.788795 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:58.847072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de581d75540c4912b21317598ad19f2e', 'request_id': 'req-a8b51127-5a76-40aa-901f-b385f58f2602'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.854462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de581d75540c4912b21317598ad19f2e', 'request_id': 'req-a8b51127-5a76-40aa-901f-b385f58f2602'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.861720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de581d75540c4912b21317598ad19f2e', 'request_id': 'req-a8b51127-5a76-40aa-901f-b385f58f2602'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.876310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] The token cache is being invalidate because project de581d75540c4912b21317598ad19f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:58.876657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.877394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:58.879141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1257/2541] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:58 2022] DELETE /identity/v3/projects/de581d75540c4912b21317598ad19f2e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:58.883432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:58.894105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc16f-e075-40b1-89fa-3b4a16a35ab3 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:58.959842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:58.960737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:58.961022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:58.961291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] PATH_INFO: `/v3/users/147110394cd64af0ad8dcfcd15774faa` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:58.962740 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147110394cd64af0ad8dcfcd15774faa)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:58.965321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:58.971087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:59.035546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147110394cd64af0ad8dcfcd15774faa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.036400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147110394cd64af0ad8dcfcd15774faa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.045101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147110394cd64af0ad8dcfcd15774faa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.054458 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147110394cd64af0ad8dcfcd15774faa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.070264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d012f938-ec94-4059-9b86-d8d1b1ed7588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147110394cd64af0ad8dcfcd15774faa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.077094 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1285/2542] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:30:58 2022] DELETE /identity/v3/users/147110394cd64af0ad8dcfcd15774faa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:30:59.381358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:59.384109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:59.406823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51127-5a76-40aa-901f-b385f58f2602 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:59.479560 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:59.480447 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.480721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.480985 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] PATH_INFO: `/v3/projects/1d88209257c84316b9c355db3339ffc8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.482301 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d88209257c84316b9c355db3339ffc8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:59.484289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:59.503013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:59.542275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d88209257c84316b9c355db3339ffc8', 'request_id': 'req-3796df34-c20c-4bd6-91d0-a3226b1ac72f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.548709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d88209257c84316b9c355db3339ffc8', 'request_id': 'req-3796df34-c20c-4bd6-91d0-a3226b1ac72f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.557344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d88209257c84316b9c355db3339ffc8', 'request_id': 'req-3796df34-c20c-4bd6-91d0-a3226b1ac72f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.576241 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] The token cache is being invalidate because project 1d88209257c84316b9c355db3339ffc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:30:59.576675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.577430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3796df34-c20c-4bd6-91d0-a3226b1ac72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:30:59.579195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1258/2543] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:30:59 2022] DELETE /identity/v3/projects/1d88209257c84316b9c355db3339ffc8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:30:59.584546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.584918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.585253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.607204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:59.608462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:59.677733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1286/2544] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:59.685796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.686116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.686393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.707188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:59.708409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:59.718440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1259/2545] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:59.722891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:59.733829 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a23ac-ed30-401d-8989-ddfb491483d2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:59.738535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:59.739225 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.739509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.739792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.740529 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:30:59.740839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:59.742513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:59.755656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1287/2546] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:30:59.760927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:59.771486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0f29f-1509-4b4e-b727-1f6be649a570 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:59.777088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:59.777816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.778176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.778502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.779382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:59.781456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:59.814210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1260/2547] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:30:59 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:30:59.819009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:59.830316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a36db-3432-4e02-b680-0f273d87a711 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:59.898764 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:59.899479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.899809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.900125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.901438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:59.903635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:59.922619 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:59.929523 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1288/2548] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:30:59 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:30:59.934956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:59.946658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347b6d-9c7d-4bae-aedb-6a35ae2daac2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:59.952564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:59.953371 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.953688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.954038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.955017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:59.956711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:59.970351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1261/2549] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:30:59.975001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:59.986776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39482410-2580-477b-842b-5ee0873af06b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:59.992029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230ef33-a3f3-46ae-9e80-fe7ab1b1f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:59.992747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230ef33-a3f3-46ae-9e80-fe7ab1b1f367 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.993087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230ef33-a3f3-46ae-9e80-fe7ab1b1f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.993401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230ef33-a3f3-46ae-9e80-fe7ab1b1f367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.994324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230ef33-a3f3-46ae-9e80-fe7ab1b1f367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:59.996077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230ef33-a3f3-46ae-9e80-fe7ab1b1f367 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:00.007799 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1289/2550] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:00.013830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:00.026288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f570-23b2-4971-b13c-7f1f17ab9d69 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:00.031618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:00.032592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:00.032915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:00.033232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] PATH_INFO: `/v3/projects/f4f1bc84c61e42e69c8e2dd1c5b2dc1a/users/b865f86847054ce1acf5c7d6d9a4257d/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:00.050858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f1bc84c61e42e69c8e2dd1c5b2dc1a, user_id=b865f86847054ce1acf5c7d6d9a4257d, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:00.053676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:00.068778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1262/2551] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:31:00 2022] PUT /identity/v3/projects/f4f1bc84c61e42e69c8e2dd1c5b2dc1a/users/b865f86847054ce1acf5c7d6d9a4257d/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:31:00.080192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ca78-3e62-4290-9112-51a35fe72abb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:00.080522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ca78-3e62-4290-9112-51a35fe72abb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:00.080837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ca78-3e62-4290-9112-51a35fe72abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:00.112013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d084ca78-3e62-4290-9112-51a35fe72abb None None] MFA Rules not processed for user `b865f86847054ce1acf5c7d6d9a4257d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:00.113399 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d084ca78-3e62-4290-9112-51a35fe72abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:00.192442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1290/2552] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:00.204867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:00.207019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:00.273397 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3a0ce-12dc-47d2-9bf9-18a7d913f9aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:00.277894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ec1ca-bd51-4ed5-bdd7-2dd4082eb622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:00.278616 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec1ca-bd51-4ed5-bdd7-2dd4082eb622 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:00.278898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec1ca-bd51-4ed5-bdd7-2dd4082eb622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:00.279176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec1ca-bd51-4ed5-bdd7-2dd4082eb622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:00.288864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ec1ca-bd51-4ed5-bdd7-2dd4082eb622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:00.290366 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ec1ca-bd51-4ed5-bdd7-2dd4082eb622 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:00.300780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1263/2553] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:31:01.764532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:01.765161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:01.765263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:01.788624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] MFA Rules not processed for user `b865f86847054ce1acf5c7d6d9a4257d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:01.789881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:01.798367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1291/2554] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:10.295962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:11.782265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=40 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:19.581356 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7860aa-181d-41d1-a60e-f6005e7226f2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:19.582088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7860aa-181d-41d1-a60e-f6005e7226f2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:19.582392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7860aa-181d-41d1-a60e-f6005e7226f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:19.606842 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4d7860aa-181d-41d1-a60e-f6005e7226f2 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:19.608152 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d7860aa-181d-41d1-a60e-f6005e7226f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:19.692950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1264/2555] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:31:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:19.760508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:19.762825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:19.900259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d9fb0-ced9-43ca-aef4-0b33f3df8849 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:19.907147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:19.907831 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:19.908116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:19.908391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:19.919590 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:19.921276 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:19.930798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1292/2556] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:31:20.573352 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472126b-62ee-4bde-b93d-65cb047ed26a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:20.573799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472126b-62ee-4bde-b93d-65cb047ed26a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:20.574175 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472126b-62ee-4bde-b93d-65cb047ed26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:20.594049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f472126b-62ee-4bde-b93d-65cb047ed26a None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:20.595288 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f472126b-62ee-4bde-b93d-65cb047ed26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:20.603170 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1265/2557] 10.222.0.61 () {58 vars in 967 bytes} [Fri May 27 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:20.617582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:20.629981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873d43f-e21a-46a8-ae7d-665a477cee36 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:20.635832 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:20.636497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:20.636782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:20.637062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:20.646353 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:20.647977 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:20.657662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1293/2558] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 03:31:20.897197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ad48-1e37-4184-b483-44eea39a967f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:20.897470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ad48-1e37-4184-b483-44eea39a967f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:20.897754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ad48-1e37-4184-b483-44eea39a967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:20.921122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f670ad48-1e37-4184-b483-44eea39a967f None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:20.923326 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f670ad48-1e37-4184-b483-44eea39a967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:20.936862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1266/2559] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:31:20.953916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:20.973588 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571a236-8496-4d47-858e-4b2211fac506 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:20.988443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:20.989580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:20.990137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:20.990607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:21.006377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:21.009490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:21.025264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1294/2560] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:31:21.437954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:21.438251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:21.438535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:21.458602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:21.459745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:21.467952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1267/2561] 10.222.0.61 () {58 vars in 967 bytes} [Fri May 27 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:31:21.482111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:21.494906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced92502-2636-436f-a66e-a991fb0cf96b service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:21.500971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a735-a51d-44c6-a4ee-3f0ba1f9ebd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:21.501713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a735-a51d-44c6-a4ee-3f0ba1f9ebd8 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:21.502100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a735-a51d-44c6-a4ee-3f0ba1f9ebd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:21.502465 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a735-a51d-44c6-a4ee-3f0ba1f9ebd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:21.514592 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a735-a51d-44c6-a4ee-3f0ba1f9ebd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:21.517663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a735-a51d-44c6-a4ee-3f0ba1f9ebd8 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:21.528890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1295/2562] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:31:23.962235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:24.064646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07002d-3c31-4c22-91b0-0a78dd51e128 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:24.069775 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:24.070709 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:24.071521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:24.071794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] PATH_INFO: `/v3/users/b865f86847054ce1acf5c7d6d9a4257d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:24.073079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b865f86847054ce1acf5c7d6d9a4257d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:24.075115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:24.132989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b865f86847054ce1acf5c7d6d9a4257d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.148130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b865f86847054ce1acf5c7d6d9a4257d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.158830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b865f86847054ce1acf5c7d6d9a4257d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.159825 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b865f86847054ce1acf5c7d6d9a4257d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.174903 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b865f86847054ce1acf5c7d6d9a4257d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.182083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1268/2563] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:31:23 2022] DELETE /identity/v3/users/b865f86847054ce1acf5c7d6d9a4257d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:31:24.187631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:24.188327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:24.188327 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:24.210157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:24.212121 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:24.287514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1296/2564] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:24.298362 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:24.299955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:24.307357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:24.381636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83200-9c39-41ea-a823-20e2bfe2b5d0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:24.388010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368ccc-d68c-41a8-b467-19c0722890c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:24.389048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368ccc-d68c-41a8-b467-19c0722890c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:24.389333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368ccc-d68c-41a8-b467-19c0722890c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:24.389609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368ccc-d68c-41a8-b467-19c0722890c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:24.401098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0368ccc-d68c-41a8-b467-19c0722890c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:24.402613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0368ccc-d68c-41a8-b467-19c0722890c1 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:24.413593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1269/2565] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:24.686846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:24.689664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:24.714727 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a47f7d-b44a-4aa1-8ae7-6947581f9a19 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:24.721379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:24.722412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:24.722848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:24.723236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] PATH_INFO: `/v3/projects/f4f1bc84c61e42e69c8e2dd1c5b2dc1a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:24.724894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f1bc84c61e42e69c8e2dd1c5b2dc1a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:24.728463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:24.806647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:24.811679 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f1bc84c61e42e69c8e2dd1c5b2dc1a', 'request_id': 'req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.823136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f1bc84c61e42e69c8e2dd1c5b2dc1a', 'request_id': 'req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.833950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f1bc84c61e42e69c8e2dd1c5b2dc1a', 'request_id': 'req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.854285 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] The token cache is being invalidate because project f4f1bc84c61e42e69c8e2dd1c5b2dc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:31:24.860103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.861273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fc2b407e-e84a-4967-a9ab-3c4795ad0eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:24.863896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1297/2566] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:31:24 2022] DELETE /identity/v3/projects/f4f1bc84c61e42e69c8e2dd1c5b2dc1a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:31:24.870538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:24.870988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:24.871420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:24.891702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:24.893184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:24.970144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1270/2567] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:24.979236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:24.979549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:24.980063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.005556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:25.007232 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:25.017581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1298/2568] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:25.022277 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.034275 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1755-a94a-4771-8907-f97cb64efdda None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.040158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.040889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.041171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.041512 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.042306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:31:25.042608 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.044268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.059328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1271/2569] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:31:25.065752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.076104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308c71d-a5b8-469d-9f2e-052050abb4be None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.080901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.081581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.081861 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.082168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.082864 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.085195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.116927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1299/2570] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:31:25 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:31:25.122048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.134820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd00ab-d684-4afa-93c9-5979e6e04d02 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.208379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.209607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.210135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.210681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.212580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.216505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.250536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1272/2571] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:31:25 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:31:25.255207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.271930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737ff14-75e6-41c9-8ead-6ca6e54d1a3b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.280421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.283010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.283010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.283010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.284442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.286778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.308149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1300/2572] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:25.313027 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.332716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1421d9-9942-4986-8ffb-c4ac56be3632 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.341466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a2493-e6d6-4744-9b5a-80395e9f25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.342678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a2493-e6d6-4744-9b5a-80395e9f25d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.343225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a2493-e6d6-4744-9b5a-80395e9f25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.343770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a2493-e6d6-4744-9b5a-80395e9f25d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.345148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a2493-e6d6-4744-9b5a-80395e9f25d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.348405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a2493-e6d6-4744-9b5a-80395e9f25d6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.369906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1273/2573] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:25.377080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.390089 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac2e40-da6e-477c-aff1-82b47a203261 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.395343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.396291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.396691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.397013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] PATH_INFO: `/v3/projects/b4735e522c414534b2aba9f82cb7a3c6/users/886feac9f52b430d8377e8d979abc987/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.421043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4735e522c414534b2aba9f82cb7a3c6, user_id=886feac9f52b430d8377e8d979abc987, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.424397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.441438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1301/2574] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:31:25 2022] PUT /identity/v3/projects/b4735e522c414534b2aba9f82cb7a3c6/users/886feac9f52b430d8377e8d979abc987/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:31:25.513147 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec2914-03d7-4a54-bbcd-5ba39befbd60 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.513416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec2914-03d7-4a54-bbcd-5ba39befbd60 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.513682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec2914-03d7-4a54-bbcd-5ba39befbd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.541841 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:25.549360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-14ec2914-03d7-4a54-bbcd-5ba39befbd60 None None] MFA Rules not processed for user `886feac9f52b430d8377e8d979abc987`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:25.550684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-14ec2914-03d7-4a54-bbcd-5ba39befbd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:25.629117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1274/2575] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:31:25.640469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:25.642264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:25.712005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224381b4-97e9-4fe1-bbc4-a944b1ff0d8b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:25.716057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:25.716872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.717262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.717633 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.728269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:25.729733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:25.740643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1302/2576] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:31:30.721434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:30.722260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:30.722260 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:30.751101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:30.752696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:30.839346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1275/2577] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:31:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:30.852621 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:30.854290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:30.953576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d02cf-eb60-4e70-a21f-8a886cc86a84 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:30.960189 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582bb14-ac30-4bad-ae26-a4633f95ffb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:30.960940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582bb14-ac30-4bad-ae26-a4633f95ffb7 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:30.961307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582bb14-ac30-4bad-ae26-a4633f95ffb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:30.962287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582bb14-ac30-4bad-ae26-a4633f95ffb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:30.973383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582bb14-ac30-4bad-ae26-a4633f95ffb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:30.975301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582bb14-ac30-4bad-ae26-a4633f95ffb7 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:30.986309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1303/2578] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:31:36.970604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:37.091345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d155cc-36b2-426e-a928-ab019b5d01e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:37.104061 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:37.105151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:37.105622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:37.105927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] PATH_INFO: `/v3/users/886feac9f52b430d8377e8d979abc987` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:37.108083 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886feac9f52b430d8377e8d979abc987)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:37.113637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:37.196635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886feac9f52b430d8377e8d979abc987'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:37.200246 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:37.223105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886feac9f52b430d8377e8d979abc987'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:37.235102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886feac9f52b430d8377e8d979abc987'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:37.236823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886feac9f52b430d8377e8d979abc987'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:37.252388 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886feac9f52b430d8377e8d979abc987'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:37.270214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1276/2579] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:31:36 2022] DELETE /identity/v3/users/886feac9f52b430d8377e8d979abc987 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:31:37.272973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:37.273571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:37.274057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:37.284282 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:37.313802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:37.316521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:37.472685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1304/2580] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:37.484964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:37.491533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:37.663890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139121f6-02ed-41e4-ab47-e3f7694a9750 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:37.673690 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e6a93-5813-4a73-9836-43c664260a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:37.674888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6a93-5813-4a73-9836-43c664260a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:37.675369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6a93-5813-4a73-9836-43c664260a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:37.675850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e6a93-5813-4a73-9836-43c664260a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:37.697735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e6a93-5813-4a73-9836-43c664260a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:37.701256 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e6a93-5813-4a73-9836-43c664260a50 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:37.724727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1277/2581] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:31:38.174443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:38.179165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:38.215905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48c7e-f2a6-471a-a523-a2e12f8c95e2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:38.224923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:38.227123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.227673 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.228508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] PATH_INFO: `/v3/projects/b4735e522c414534b2aba9f82cb7a3c6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.230879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4735e522c414534b2aba9f82cb7a3c6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:38.235442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:38.307307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4735e522c414534b2aba9f82cb7a3c6', 'request_id': 'req-ddcc42da-d275-4002-9fab-170c9b5d956d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:38.316145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4735e522c414534b2aba9f82cb7a3c6', 'request_id': 'req-ddcc42da-d275-4002-9fab-170c9b5d956d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:38.333038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4735e522c414534b2aba9f82cb7a3c6', 'request_id': 'req-ddcc42da-d275-4002-9fab-170c9b5d956d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:38.364589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] The token cache is being invalidate because project b4735e522c414534b2aba9f82cb7a3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:31:38.365151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:38.366167 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ddcc42da-d275-4002-9fab-170c9b5d956d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:31:38.373669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1305/2582] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:31:38 2022] DELETE /identity/v3/projects/b4735e522c414534b2aba9f82cb7a3c6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:31:38.376782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.377540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.378155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.425409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:38.427412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:38.562204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1278/2583] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:38.570009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.570527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.571047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.605574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:38.607245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:38.617437 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1306/2584] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:31:38.623704 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:38.636732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a489e-7cef-4a1a-b1bc-484ab25471d7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:38.642520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:38.643217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.643504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.643785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.644543 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:31:38.644855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:38.646818 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:38.661889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1279/2585] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:31:38.669718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:38.690137 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f7834-71f0-4b76-a65b-3edd8e8bba81 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:38.702043 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:38.703277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.703782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.704273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.705607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:38.709287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:38.748342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1307/2586] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:31:38 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:31:38.755858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:38.775469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b719-1697-4534-bf8d-2e3c16bef7fd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:38.902314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:38.914402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:38.916382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.917138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.917796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.918900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:38.921643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:38.955407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1280/2587] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:31:38 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:31:38.960145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:38.981486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8b8c2-6fa9-4766-8fce-58e82c2ab6a3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:38.992096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:38.992096 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:38.992466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:38.994620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:38.996181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:38.999853 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:39.030252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1308/2588] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:39.035151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:39.050419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057fa6-83f6-44f0-95e9-5fafb8527775 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:39.056851 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308a476-e004-4a51-92fc-88b5a842fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:39.057592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a476-e004-4a51-92fc-88b5a842fdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:39.057899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a476-e004-4a51-92fc-88b5a842fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:39.058242 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a476-e004-4a51-92fc-88b5a842fdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:39.059111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308a476-e004-4a51-92fc-88b5a842fdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:39.060946 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308a476-e004-4a51-92fc-88b5a842fdd7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:39.075894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1281/2589] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:39.081674 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:39.102761 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306b41-0b19-44b0-9f66-9c7de2b8ef99 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:39.114026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:39.115892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:39.116600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:39.117525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] PATH_INFO: `/v3/projects/720658bab13b482abce02d83d87f29e6/users/8cc1ba0c0b6a4fffb775c1ab62e73360/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:39.151058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720658bab13b482abce02d83d87f29e6, user_id=8cc1ba0c0b6a4fffb775c1ab62e73360, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:39.154118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:39.183836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1309/2590] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:31:39 2022] PUT /identity/v3/projects/720658bab13b482abce02d83d87f29e6/users/8cc1ba0c0b6a4fffb775c1ab62e73360/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:31:39.191202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a75b-6d8b-4d13-84fe-d51c7685a8de None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:39.191487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a75b-6d8b-4d13-84fe-d51c7685a8de None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:39.191757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a75b-6d8b-4d13-84fe-d51c7685a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:39.210994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8009a75b-6d8b-4d13-84fe-d51c7685a8de None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:39.212474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8009a75b-6d8b-4d13-84fe-d51c7685a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:39.317203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1282/2591] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:39.332142 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:39.334383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:39.378989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:39.438376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcfde2-b078-41db-963a-b0f81ee4a360 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:39.442741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:39.443478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:39.443676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:39.443956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:39.457662 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:39.461800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:39.486525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1310/2592] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:47.023039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.023886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.023886 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.072791 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] MFA Rules not processed for user `8cc1ba0c0b6a4fffb775c1ab62e73360`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:47.073952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:47.154837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1283/2593] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:47.159716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:47.171346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898609-44e6-4713-b8ac-54a2b59ed9b8 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:47.176181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:47.176860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.177146 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.177420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.178168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:47.180212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:47.218655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1311/2594] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:31:47 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:31:47.223105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:47.235359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1037e8-b78a-4ea2-b663-1fddd7b777e1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:47.304360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:47.305049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.305398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.306208 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.306940 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:47.308932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:47.320402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:47.340792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1284/2595] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:31:47 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:31:47.345914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:47.366281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd5af-96f5-45a4-937a-5f85436baf3f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:47.374865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:47.376062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.376561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.377088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.378542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:47.381349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:47.395526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1312/2596] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:47.400332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:47.412975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed3ee3-4291-4494-a678-4474e30a01b1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:47.421688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:47.422934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.423322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.423794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] PATH_INFO: `/v3/projects/bf42fdda2ec6419abb909a2732893905/users/e9ac8fcdc0ba4fe8ac9a6100ca6176a6/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.445936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf42fdda2ec6419abb909a2732893905, user_id=e9ac8fcdc0ba4fe8ac9a6100ca6176a6, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:47.449114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:47.469304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1285/2597] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:31:47 2022] PUT /identity/v3/projects/bf42fdda2ec6419abb909a2732893905/users/e9ac8fcdc0ba4fe8ac9a6100ca6176a6/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:31:47.473781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:47.486237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bbc6-3075-4cd3-a14e-fee7362cd5ec admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:47.592763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f36ffa-7347-484e-be78-471fdc490f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:47.593375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f36ffa-7347-484e-be78-471fdc490f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.593659 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f36ffa-7347-484e-be78-471fdc490f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.593937 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f36ffa-7347-484e-be78-471fdc490f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.594757 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f36ffa-7347-484e-be78-471fdc490f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:47.596450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f36ffa-7347-484e-be78-471fdc490f89 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:47.613848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1313/2598] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:31:47.615551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:47.636721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6098bf3-b98b-4ea1-a396-b2aee04f9595 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:47.644881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5e65-e05f-42e4-9569-3ac706e7f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:47.646565 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5e65-e05f-42e4-9569-3ac706e7f9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:47.647250 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5e65-e05f-42e4-9569-3ac706e7f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:47.647770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5e65-e05f-42e4-9569-3ac706e7f9d7 admin admin] PATH_INFO: `/v3/projects/bf42fdda2ec6419abb909a2732893905/users/e9ac8fcdc0ba4fe8ac9a6100ca6176a6/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:47.652194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5e65-e05f-42e4-9569-3ac706e7f9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf42fdda2ec6419abb909a2732893905, user_id=e9ac8fcdc0ba4fe8ac9a6100ca6176a6, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:47.657645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5e65-e05f-42e4-9569-3ac706e7f9d7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:47.669879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1286/2599] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:31:47 2022] PUT /identity/v3/projects/bf42fdda2ec6419abb909a2732893905/users/e9ac8fcdc0ba4fe8ac9a6100ca6176a6/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:31:50.822199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2cd75-2447-4cfc-bfb4-b820766d7fdc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:50.823777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2cd75-2447-4cfc-bfb4-b820766d7fdc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:50.824591 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2cd75-2447-4cfc-bfb4-b820766d7fdc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:50.828149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1314/2600] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:31:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:50.838020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc16f-8b0e-47b5-841b-d471962ce893 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:50.838830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc16f-8b0e-47b5-841b-d471962ce893 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:50.838830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc16f-8b0e-47b5-841b-d471962ce893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:50.867960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-07bbc16f-8b0e-47b5-841b-d471962ce893 None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:50.869537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-07bbc16f-8b0e-47b5-841b-d471962ce893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:50.968927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1287/2601] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:31:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:50.990119 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2cd75-2447-4cfc-bfb4-b820766d7fdc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:50.993074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-97b2cd75-2447-4cfc-bfb4-b820766d7fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:51.080576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2cd75-2447-4cfc-bfb4-b820766d7fdc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:51.096988 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571dba9-34ac-4a1e-aac6-6f739cf17859 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:51.097573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571dba9-34ac-4a1e-aac6-6f739cf17859 service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.098066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571dba9-34ac-4a1e-aac6-6f739cf17859 service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.098348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571dba9-34ac-4a1e-aac6-6f739cf17859 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.118125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571dba9-34ac-4a1e-aac6-6f739cf17859 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:51.121039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571dba9-34ac-4a1e-aac6-6f739cf17859 service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:51.145117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1315/2602] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:51.251448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f76c-dcbc-42e5-b1b5-b37e1370f40d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.251789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f76c-dcbc-42e5-b1b5-b37e1370f40d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.252076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f76c-dcbc-42e5-b1b5-b37e1370f40d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.254024 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1288/2603] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:51.261896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3fbb4-c5db-4fc9-8eed-5792c0c09d2e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.262242 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3fbb4-c5db-4fc9-8eed-5792c0c09d2e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.262635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3fbb4-c5db-4fc9-8eed-5792c0c09d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.288882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-04f3fbb4-c5db-4fc9-8eed-5792c0c09d2e None None] MFA Rules not processed for user `aa9aadf0069b45758a89cfb6a737082d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:51.290833 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-04f3fbb4-c5db-4fc9-8eed-5792c0c09d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:51.337178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:51.410161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1316/2604] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:51.418521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f76c-dcbc-42e5-b1b5-b37e1370f40d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:51.420921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22b5f76c-dcbc-42e5-b1b5-b37e1370f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:51.437895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f76c-dcbc-42e5-b1b5-b37e1370f40d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:51.445506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a66b59-a2d4-4558-91e5-d88f1b5fe498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:51.446535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a66b59-a2d4-4558-91e5-d88f1b5fe498 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.447137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a66b59-a2d4-4558-91e5-d88f1b5fe498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.447604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a66b59-a2d4-4558-91e5-d88f1b5fe498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.457702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a66b59-a2d4-4558-91e5-d88f1b5fe498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:51.459557 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a66b59-a2d4-4558-91e5-d88f1b5fe498 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:51.484623 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1289/2605] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:51.632785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69899db-eea0-475c-8c67-0a173608cb6b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.633569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69899db-eea0-475c-8c67-0a173608cb6b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.634942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69899db-eea0-475c-8c67-0a173608cb6b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.638783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1317/2606] 10.222.0.61 () {54 vars in 921 bytes} [Fri May 27 03:31:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:51.652309 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.653817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.653817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.699604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] MFA Rules not processed for user `9799f9d11546403e8b46ad386be470d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:51.701014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:51.730999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1290/2607] 10.222.0.61 () {58 vars in 1018 bytes} [Fri May 27 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:51.744481 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69899db-eea0-475c-8c67-0a173608cb6b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:51.764375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69899db-eea0-475c-8c67-0a173608cb6b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:51.786857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9054b-0b4c-40c2-babf-48ab8fec84c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:51.787595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9054b-0b4c-40c2-babf-48ab8fec84c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:51.787759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9054b-0b4c-40c2-babf-48ab8fec84c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:51.788050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9054b-0b4c-40c2-babf-48ab8fec84c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:51.845303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9054b-0b4c-40c2-babf-48ab8fec84c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:51.847839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9054b-0b4c-40c2-babf-48ab8fec84c8 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:51.875455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1318/2608] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:52.659805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:52.661469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:52.853370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b1e02-227a-4246-ad4a-6700f6bf150d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:52.860029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:52.860720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:52.861059 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:52.861346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:52.866067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:52.893911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:52.895670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052b998-aec4-41b6-8b89-49a94cd2f831 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:52.908273 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1291/2609] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:31:55.195608 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:55.197995 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:55.198967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:55.262481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:55.264581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:55.265342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:55.292325 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] MFA Rules not processed for user `e9ac8fcdc0ba4fe8ac9a6100ca6176a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:55.296355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:55.327164 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:55.328713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:55.352567 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:55.449308 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1319/2610] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:31:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:55.463109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1292/2611] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:31:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:31:55.473009 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:55.490660 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640e96-959e-4732-84ab-2b3b70a8a18a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:55.495420 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:55.497361 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:55.510877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f646e6869e44b20adf102b964394512', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:55.516104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:55.516846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:55.517472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:55.638105 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d85a-c3d6-4279-ae17-c6bc3ece9d97 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:55.645999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6443-49d2-4c83-9bbc-bf13f3f2d333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:55.647118 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6443-49d2-4c83-9bbc-bf13f3f2d333 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:55.647655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6443-49d2-4c83-9bbc-bf13f3f2d333 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:55.648358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6443-49d2-4c83-9bbc-bf13f3f2d333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:55.660304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6443-49d2-4c83-9bbc-bf13f3f2d333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:55.662725 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6443-49d2-4c83-9bbc-bf13f3f2d333 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:55.672928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1293/2612] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 03:31:55.695315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:55.697516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:55.735814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1320/2613] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:31:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:31:55.940609 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ce7e-4e82-4687-871f-4879fa60a8f7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:55.941207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ce7e-4e82-4687-871f-4879fa60a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:55.941674 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ce7e-4e82-4687-871f-4879fa60a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:55.983125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f5b7ce7e-4e82-4687-871f-4879fa60a8f7 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:55.984593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5b7ce7e-4e82-4687-871f-4879fa60a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:55.998333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1294/2614] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:31:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:56.030716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:56.063456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf11d-7a75-4643-a56a-8c22c5185a13 service glance] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:56.076493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba52141-4888-4b45-a3f8-5522d5f3d745 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:56.078286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba52141-4888-4b45-a3f8-5522d5f3d745 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:56.079151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba52141-4888-4b45-a3f8-5522d5f3d745 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:56.080213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba52141-4888-4b45-a3f8-5522d5f3d745 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:56.112377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba52141-4888-4b45-a3f8-5522d5f3d745 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:56.116887 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba52141-4888-4b45-a3f8-5522d5f3d745 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:56.142863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1321/2615] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:31:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:32:05.971423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=51 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:06.134309 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=83 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:11.729165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d6be-3efd-4804-a73f-cfdc691051f2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:11.729948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d6be-3efd-4804-a73f-cfdc691051f2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:11.729948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d6be-3efd-4804-a73f-cfdc691051f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:11.778801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-86e6d6be-3efd-4804-a73f-cfdc691051f2 None None] MFA Rules not processed for user `8cc1ba0c0b6a4fffb775c1ab62e73360`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:11.780912 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86e6d6be-3efd-4804-a73f-cfdc691051f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:11.809539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1295/2616] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:14.993943 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:14.994719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:14.994719 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:15.013410 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] MFA Rules not processed for user `144457df5bd2420796f8f8d6bbce7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:15.014734 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:15.078049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1322/2617] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:17.484073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6587ee-45ec-456a-b2ef-4592d2a47798 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:17.484911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6587ee-45ec-456a-b2ef-4592d2a47798 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:17.485062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6587ee-45ec-456a-b2ef-4592d2a47798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:17.506378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3a6587ee-45ec-456a-b2ef-4592d2a47798 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:17.507615 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3a6587ee-45ec-456a-b2ef-4592d2a47798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:17.516419 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1296/2618] 10.222.0.61 () {58 vars in 1009 bytes} [Fri May 27 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:17.530845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:17.546587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cf441-c9f0-4f85-bf3c-3f3e60a63178 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:17.552007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:17.552691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:17.552986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:17.553238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:17.564844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:17.567000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:17.577445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1323/2619] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:32:27.500462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:27.573642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=31 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:31.031328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:31.031913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:31.032318 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:31.064527 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:31.066738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:31.081456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1297/2620] 10.222.0.61 () {58 vars in 967 bytes} [Fri May 27 03:32:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:31.125914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:31.140845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14dc4a-505e-431e-9094-4691a8e66a41 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:31.147052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:31.147721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:31.148006 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:31.148284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:31.159081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:31.161038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:31.172966 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1324/2621] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:32:41.055712 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:41.168586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:49.282344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:49.292786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a20353-ba7b-45da-9ea9-2341b4917408 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:49.296449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:49.297121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:49.297406 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:49.297681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:49.308401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:49.309892 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:49.321548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1298/2622] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:32:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:59.315789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:00.581562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:00.584912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb1a03-ca16-4b85-bab2-801e27ccc454 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:00.589179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:00.589828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:00.590139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:00.590414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:00.592259 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:00.603643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:00.606217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:00.619555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1325/2623] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:33:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:33:00.732846 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:00.750592 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45c12-9f4d-47e1-b6eb-3b41e2bd7fbd service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:00.759650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:00.760585 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:00.760986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:00.761380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:00.763970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:00.779415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:00.780878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:00.793652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1299/2624] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:33:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:33:10.612260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:10.788135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:47.289131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:47.299654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f211-3bb3-4ae7-bed8-6a1aa708efdf service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:47.303897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:47.304612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:47.304930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:47.305253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:47.307303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:47.385215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:47.387002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:47.401540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1326/2625] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:33:51.636872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:51.639210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:51.661299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c3d96-722b-4fc3-a7f6-638d350a5aa3 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:51.667320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:51.668363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:51.668648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:51.668928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] PATH_INFO: `/v3/users/1b6e4c96f7054aaeaafebfecdd960467` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:51.670319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6e4c96f7054aaeaafebfecdd960467)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:51.672294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:51.739457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6e4c96f7054aaeaafebfecdd960467'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:51.757673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6e4c96f7054aaeaafebfecdd960467'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:51.767996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6e4c96f7054aaeaafebfecdd960467'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:51.768670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6e4c96f7054aaeaafebfecdd960467'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:51.777871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78a6e576-075c-48e6-bba9-409cc3a29809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6e4c96f7054aaeaafebfecdd960467'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:51.785002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1300/2626] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:33:51 2022] DELETE /identity/v3/users/1b6e4c96f7054aaeaafebfecdd960467 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:33:52.011872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.023369 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf3899-9446-4e5e-9351-a6d19bde632c service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.099344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.100195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.100558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.100878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] PATH_INFO: `/v3/projects/34209acea19c42ef84ad5f6c20e5c0a9` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.102797 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34209acea19c42ef84ad5f6c20e5c0a9)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.105059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.174526 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34209acea19c42ef84ad5f6c20e5c0a9', 'request_id': 'req-29665493-97da-4992-bac8-ae73ef8c6118'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:52.182155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34209acea19c42ef84ad5f6c20e5c0a9', 'request_id': 'req-29665493-97da-4992-bac8-ae73ef8c6118'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:52.191381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34209acea19c42ef84ad5f6c20e5c0a9', 'request_id': 'req-29665493-97da-4992-bac8-ae73ef8c6118'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:52.208457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] The token cache is being invalidate because project 34209acea19c42ef84ad5f6c20e5c0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:33:52.208774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:52.209428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-29665493-97da-4992-bac8-ae73ef8c6118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:33:52.211688 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1327/2627] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:33:52 2022] DELETE /identity/v3/projects/34209acea19c42ef84ad5f6c20e5c0a9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:33:52.217724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.218117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.218403 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.240060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:33:52.241670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:52.311045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1301/2628] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:33:52.319501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.319936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.320787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.344263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:33:52.345700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:52.357513 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1328/2629] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:33:52.363823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.377410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4d20-624d-4236-91c4-22a79e7e4be9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.383306 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.384233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.384653 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.385040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.385902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:33:52.386436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.388329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.402594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1302/2630] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:33:52.407203 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.418253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6ba45-b96f-4bac-bd57-b8bb8cb3ee64 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.423401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.424151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.424367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.424644 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.425363 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.427408 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.449184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:52.471255 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1329/2631] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:33:52 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:33:52.478125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.505602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43405-f5d2-439c-9d19-82e8d52b67e4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.597991 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.598699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.598978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.599252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.599945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.602486 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.610374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:52.632078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1303/2632] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:33:52 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:33:52.636690 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.648379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093799-c100-47e6-9bf4-08a24cc474e7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.653651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.654424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.654701 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.654975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.655718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.657417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.670653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1330/2633] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:33:52.675418 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.688525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c6d6d-c916-4d61-aba1-96c8dcec03b7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.693468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f00fd-d63b-4cf2-8420-2078292a3ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.694186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f00fd-d63b-4cf2-8420-2078292a3ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.694465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f00fd-d63b-4cf2-8420-2078292a3ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.694741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f00fd-d63b-4cf2-8420-2078292a3ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.695499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f00fd-d63b-4cf2-8420-2078292a3ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.697162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f00fd-d63b-4cf2-8420-2078292a3ad4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.709407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1304/2634] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:33:52.716447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.735078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599999fe-f78c-4314-a991-1ab22c702cf3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.743056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.744904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.745293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.745733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] PATH_INFO: `/v3/projects/4ef1cbec0c354158ba9b1b0d85634702/users/406486b0d8b04508874496d7b741f619/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.774709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef1cbec0c354158ba9b1b0d85634702, user_id=406486b0d8b04508874496d7b741f619, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:52.780192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:52.799792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1331/2635] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:33:52 2022] PUT /identity/v3/projects/4ef1cbec0c354158ba9b1b0d85634702/users/406486b0d8b04508874496d7b741f619/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:33:52.807264 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef5da-3be1-4b69-a3fd-1f641facb2c9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.807603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef5da-3be1-4b69-a3fd-1f641facb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.807942 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef5da-3be1-4b69-a3fd-1f641facb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:52.830869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-08aef5da-3be1-4b69-a3fd-1f641facb2c9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:33:52.832233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-08aef5da-3be1-4b69-a3fd-1f641facb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:52.903426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1305/2636] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:33:52.915589 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:52.918859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:52.986086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91724ad1-ed6c-459a-937f-e0edf6f64fba admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:52.989986 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:52.990655 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:52.990933 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:52.991204 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:53.001393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:53.002870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:53.014211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1332/2637] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:33:58.755401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736919ba-b36c-4c52-ba36-7c658eab26ef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:58.755997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736919ba-b36c-4c52-ba36-7c658eab26ef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:58.755997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736919ba-b36c-4c52-ba36-7c658eab26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:58.788830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-736919ba-b36c-4c52-ba36-7c658eab26ef None None] MFA Rules not processed for user `406486b0d8b04508874496d7b741f619`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:33:58.790862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-736919ba-b36c-4c52-ba36-7c658eab26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:58.866243 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1306/2638] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:33:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:33:58.883372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:33:58.886615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:33:58.975257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9455c-80c5-47f0-a6dd-4c7ea1162bbf service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:33:58.982604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:33:58.983239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:33:58.983527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:33:58.983801 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:33:58.993045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:33:58.994722 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:33:59.005237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1333/2639] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:33:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:00.913107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:00.913732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:00.913732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:00.935796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] MFA Rules not processed for user `406486b0d8b04508874496d7b741f619`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:00.937040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:00.944396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1307/2640] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:09.000717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:10.929539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:20.389598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:20.391187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:20.405425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded9b7-14d6-41bb-8ae2-0ba950ade2e8 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:20.412139 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:20.413496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:20.414706 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:20.415235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:20.418820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:20.450266 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:20.452954 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:20.469550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1334/2641] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:25.742864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:25.755898 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0da875-3c03-463a-8d52-b052f965ac94 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:25.760668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:25.761642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:25.762071 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:25.762667 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:25.764987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:25.784922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:25.786668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:25.800017 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1308/2642] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:27.572032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:27.582050 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174e58a-be34-4f67-84bc-83820e6e3141 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:27.586665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:27.587329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:27.587609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:27.587880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:27.589882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:27.606759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:27.608243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:27.619440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1335/2643] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:31.642331 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:31.644177 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:31.702750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:31.704897 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:31.728507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdc853-1809-4c01-b0ec-a7619be3a59e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:31.733586 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:31.734651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:31.735003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:31.735413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] PATH_INFO: `/v3/users/144457df5bd2420796f8f8d6bbce7c0c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:31.736775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144457df5bd2420796f8f8d6bbce7c0c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:31.738866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:31.781232 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0c679-f5fa-413d-b3b7-459bd1c1c2bc service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:31.792809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:31.794026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:31.794521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:31.795006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:31.797794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:31.809490 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144457df5bd2420796f8f8d6bbce7c0c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:31.810244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144457df5bd2420796f8f8d6bbce7c0c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:31.814176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:31.816158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:31.820604 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144457df5bd2420796f8f8d6bbce7c0c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:31.831647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144457df5bd2420796f8f8d6bbce7c0c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:31.833610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1309/2644] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:31.853058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-42038482-97c8-4ea2-a239-c773650b8f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144457df5bd2420796f8f8d6bbce7c0c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:31.865711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1336/2645] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:34:31 2022] DELETE /identity/v3/users/144457df5bd2420796f8f8d6bbce7c0c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:34:32.072546 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.088199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0f944-7ff4-4f42-a11e-9d014ff48246 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.190312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.192290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.193276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.194084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] PATH_INFO: `/v3/projects/b09fb0dcd7bb437fa67b973ddd9cdddc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.197143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09fb0dcd7bb437fa67b973ddd9cdddc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.201705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.261304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09fb0dcd7bb437fa67b973ddd9cdddc', 'request_id': 'req-df32febb-6998-47ce-878a-fbfec1c2bc08'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:32.267605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09fb0dcd7bb437fa67b973ddd9cdddc', 'request_id': 'req-df32febb-6998-47ce-878a-fbfec1c2bc08'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:32.275470 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09fb0dcd7bb437fa67b973ddd9cdddc', 'request_id': 'req-df32febb-6998-47ce-878a-fbfec1c2bc08'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:32.290479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] The token cache is being invalidate because project b09fb0dcd7bb437fa67b973ddd9cdddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:34:32.290765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:32.291427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-df32febb-6998-47ce-878a-fbfec1c2bc08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:32.293095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1310/2646] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:34:32 2022] DELETE /identity/v3/projects/b09fb0dcd7bb437fa67b973ddd9cdddc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:34:32.299672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.300197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.300746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.331881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:32.333125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:32.421197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1337/2647] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:32.430578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.431051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.431438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.450226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:32.460513 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:32.463939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:32.486172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1311/2648] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:32.495274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.513161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb886a-a6a5-46e1-bb0f-52dfaf8090d0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.524238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.525156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.525536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.525912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.527256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:34:32.527451 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.529750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.554102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1338/2649] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:34:32.561073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.584099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad5a9e-0286-4a17-a64b-017a0fb559bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.597021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.598263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.599077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.599532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.601453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.606636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.671523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1312/2650] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:34:32 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:34:32.673286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.692438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19339d-6a35-4744-901c-a65cabe79f72 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.729798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:32.768514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.769704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.770293 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.770777 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.772103 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.775935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.805155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1339/2651] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:34:32 2022] POST /identity/v3/users => generated 278 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:34:32.810185 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.827996 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39728f-56a0-45ec-9160-4257260a6809 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.834665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.835394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.835817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.836207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.837333 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.839488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.855564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1313/2652] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:34:32.860263 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.872374 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a40d-a10b-426a-8871-fadf819f12a3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.879000 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bf2bc-524b-4810-a66e-8d0514630684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.879819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf2bc-524b-4810-a66e-8d0514630684 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.880150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf2bc-524b-4810-a66e-8d0514630684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.880472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf2bc-524b-4810-a66e-8d0514630684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.881307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bf2bc-524b-4810-a66e-8d0514630684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.883782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bf2bc-524b-4810-a66e-8d0514630684 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.897125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1340/2653] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:34:32.902676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:32.921029 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e13b-16b3-44a1-8896-0beee456a7b7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:32.928976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:32.931139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:32.932900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:32.933389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] PATH_INFO: `/v3/projects/2ec27d418e3d44959733983cf7bfdbc7/users/07e3fc889e3d464f959c116b8dfb2209/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:32.961566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec27d418e3d44959733983cf7bfdbc7, user_id=07e3fc889e3d464f959c116b8dfb2209, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:32.967047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:32.986405 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1314/2654] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:34:32 2022] PUT /identity/v3/projects/2ec27d418e3d44959733983cf7bfdbc7/users/07e3fc889e3d464f959c116b8dfb2209/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:33.004593 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.004989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.005359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.037002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] MFA Rules not processed for user `07e3fc889e3d464f959c116b8dfb2209`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:33.038281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:33.128319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1341/2655] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:33.137295 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.224666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c323-d14d-4576-8803-e2ab33df163c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.230119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.230839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.231124 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.231409 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.232115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.234108 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.264682 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1315/2656] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:34:33 2022] POST /identity/v3/projects => generated 357 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:34:33.269521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.282617 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad2283-bd70-4a5f-99d8-cd5392a40967 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.348936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.349747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.350212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.350636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.351503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.353733 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.376536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1342/2657] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:34:33 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:34:33.382556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.394555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad8fb5-a4ef-4765-b6d9-6c7aeabd4320 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.399834 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.400622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.401221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.401603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.402541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.405069 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.418976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1316/2658] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:34:33.423641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.435113 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427604d9-e445-4e24-a9bf-3e39d2dbf535 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.440104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.441020 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.441303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.441581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] PATH_INFO: `/v3/projects/4ad2e37cf7584fc4a569acea66fff115/users/cd7e9fa04f73410bb6f2a8754a64d642/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.463401 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad2e37cf7584fc4a569acea66fff115, user_id=cd7e9fa04f73410bb6f2a8754a64d642, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.466339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.484788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1343/2659] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:34:33 2022] PUT /identity/v3/projects/4ad2e37cf7584fc4a569acea66fff115/users/cd7e9fa04f73410bb6f2a8754a64d642/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:34:33.489372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.501809 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a048840-3bb0-44f0-a51e-9451c059f108 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.568019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801c9b-f53e-400e-9237-481de912e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.569102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801c9b-f53e-400e-9237-481de912e8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.569563 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801c9b-f53e-400e-9237-481de912e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.570004 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801c9b-f53e-400e-9237-481de912e8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.570971 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801c9b-f53e-400e-9237-481de912e8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.572835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801c9b-f53e-400e-9237-481de912e8e9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.584220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1317/2660] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:34:33.591651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.611902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7222d51-e41c-4931-9326-bb01da2cbb1f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.618156 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.619174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.619468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.619738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] PATH_INFO: `/v3/projects/4ad2e37cf7584fc4a569acea66fff115/users/cd7e9fa04f73410bb6f2a8754a64d642/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.621845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad2e37cf7584fc4a569acea66fff115, user_id=cd7e9fa04f73410bb6f2a8754a64d642, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.624699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.627508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:33.640584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1344/2661] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:34:33 2022] PUT /identity/v3/projects/4ad2e37cf7584fc4a569acea66fff115/users/cd7e9fa04f73410bb6f2a8754a64d642/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:33.653212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.653499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.653772 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.682738 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:33.687796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] MFA Rules not processed for user `cd7e9fa04f73410bb6f2a8754a64d642`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:33.690384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:33.776687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1318/2662] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:33 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:34:33.791976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:33.795095 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:33.902284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da653d-801c-4edb-9fec-9964d1bfa259 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:33.906428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:33.907166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:33.907492 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:33.907824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:33.918697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:33.920222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:33.931869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1345/2663] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:33 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:34.025848 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:34.036672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5030493-56f2-42e6-9a00-fdc86781f038 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:34.041186 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:34.041948 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:34.042322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:34.042643 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:34.110724 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:34.112252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:34.123184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1319/2664] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:34 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:43.926249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:44.118270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=56 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:48.800158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:48.801721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:48.872578 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa553-45ac-4659-a334-29af857e24b9 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:48.876695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:48.877367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:48.877759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:48.878086 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:48.880003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:48.947068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:48.948774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:48.960379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1346/2665] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:49.903237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:49.985917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b02aa4-f1b6-4ce5-a6b0-19157c5f3d3a service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:49.991873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:49.993359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:49.993882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:49.994319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] PATH_INFO: `/v3/users/07e3fc889e3d464f959c116b8dfb2209` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:49.995887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e3fc889e3d464f959c116b8dfb2209)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:49.998278 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:50.103456 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e3fc889e3d464f959c116b8dfb2209'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:50.110190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:50.113067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:50.135832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e3fc889e3d464f959c116b8dfb2209'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:50.147153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e3fc889e3d464f959c116b8dfb2209'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:50.148823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e3fc889e3d464f959c116b8dfb2209'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:50.159265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-648ce0ac-e961-45f2-ad04-9cc46aa68be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e3fc889e3d464f959c116b8dfb2209'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:50.173012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1320/2666] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:34:49 2022] DELETE /identity/v3/users/07e3fc889e3d464f959c116b8dfb2209 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:50.179407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:50.181474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:50.182085 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:50.229993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:50.237657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:50.270015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccfc26-6bc9-4739-84b4-b235ff15614e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:50.336978 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:50.364165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:50.364881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:50.365365 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:50.366010 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:50.369698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:50.394068 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:50.395981 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:50.420506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1347/2667] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:50.422099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1321/2668] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:50.437145 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:50.440842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:50.572118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe2c82-5ffe-4a67-a276-2efd4a37c6db service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:50.579653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:50.583106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:50.583106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:50.583106 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:50.600595 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:50.603698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:50.628393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1348/2669] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:51.014921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:51.018271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:51.037197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fe09-fb8a-4c2b-b756-6f7a87f4ac8d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:51.044644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:51.045784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:51.046826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:51.047300 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] PATH_INFO: `/v3/projects/2ec27d418e3d44959733983cf7bfdbc7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:51.048982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec27d418e3d44959733983cf7bfdbc7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:51.051196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:51.082114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:51.136028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec27d418e3d44959733983cf7bfdbc7', 'request_id': 'req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.143820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec27d418e3d44959733983cf7bfdbc7', 'request_id': 'req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.153541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec27d418e3d44959733983cf7bfdbc7', 'request_id': 'req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.174086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] The token cache is being invalidate because project 2ec27d418e3d44959733983cf7bfdbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:34:51.174427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.175207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.177922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1322/2670] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:34:51 2022] DELETE /identity/v3/projects/2ec27d418e3d44959733983cf7bfdbc7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:51.183894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:51.198953 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b87290-cfe6-4812-9938-cebce6ae0f00 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:51.314112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:51.315656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:51.316176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:51.316667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] PATH_INFO: `/v3/users/cd7e9fa04f73410bb6f2a8754a64d642` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:51.319001 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7e9fa04f73410bb6f2a8754a64d642)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:51.323488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:51.392784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7e9fa04f73410bb6f2a8754a64d642'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.393540 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7e9fa04f73410bb6f2a8754a64d642'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.402055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7e9fa04f73410bb6f2a8754a64d642'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.410865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7e9fa04f73410bb6f2a8754a64d642'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.426552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7e9fa04f73410bb6f2a8754a64d642'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:51.429930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:51.436355 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1349/2671] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:34:51 2022] DELETE /identity/v3/users/cd7e9fa04f73410bb6f2a8754a64d642 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:34:51.477054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:51.478580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:51.595778 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c87a2-bfec-44dd-b9e1-77cd91e7af7b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:51.701416 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:51.703136 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:51.703618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:51.704102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:51.708050 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:51.742344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:51.752369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dfd94-d3d5-4436-92fc-bdf1dc57204e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:51.769986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1323/2672] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:34:51.941032 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:51.946815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:52.085300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d47c-3263-41b8-b63c-1790d0719161 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.093023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.094642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.095118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.095583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] PATH_INFO: `/v3/projects/4ad2e37cf7584fc4a569acea66fff115` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.097907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad2e37cf7584fc4a569acea66fff115)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.101747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.192387 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad2e37cf7584fc4a569acea66fff115', 'request_id': 'req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:52.212433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad2e37cf7584fc4a569acea66fff115', 'request_id': 'req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:52.229480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad2e37cf7584fc4a569acea66fff115', 'request_id': 'req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:52.251618 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] The token cache is being invalidate because project 4ad2e37cf7584fc4a569acea66fff115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:34:52.252244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:52.253441 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372b0f2f-1e11-4ca3-a700-a11aad60e3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:52.256775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1350/2673] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:34:51 2022] DELETE /identity/v3/projects/4ad2e37cf7584fc4a569acea66fff115 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:52.262891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.263777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.263777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.285393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:52.287782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:52.415986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1324/2674] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:52.420184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893add20-2abe-4fd3-b538-7148e632907a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.421515 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893add20-2abe-4fd3-b538-7148e632907a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.422097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893add20-2abe-4fd3-b538-7148e632907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.447003 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-893add20-2abe-4fd3-b538-7148e632907a None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:52.448989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-893add20-2abe-4fd3-b538-7148e632907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:52.458934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1351/2675] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:52.463610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:52.469427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:52.478661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81195-d253-4a91-8944-7054b37fba1e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.486613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.494046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.494046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.494046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.494046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:34:52.494046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.494046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.512719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1325/2676] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:34:52.519818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893add20-2abe-4fd3-b538-7148e632907a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:52.537403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893add20-2abe-4fd3-b538-7148e632907a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.546381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.547553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.548056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.548528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.549783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.553620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.608254 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1352/2677] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:34:52 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:34:52.610193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:52.628504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121eaec-86bf-4848-8f7c-bda8ca067f48 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.730269 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.731120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.731538 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.732007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.732816 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.734981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.761014 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1326/2678] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:34:52 2022] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:34:52.766264 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:52.780341 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023e47d-eed7-4752-8326-a564493863da admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.786168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.787111 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.787594 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.788077 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.789130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.791546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.807605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1353/2679] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:34:52.812883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:52.827042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf138a-8449-4bb5-82b6-cf409046778b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.834323 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834b22e-17bd-4d56-9524-e750eb74872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.835133 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834b22e-17bd-4d56-9524-e750eb74872d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.835577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834b22e-17bd-4d56-9524-e750eb74872d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.835922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834b22e-17bd-4d56-9524-e750eb74872d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.836735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834b22e-17bd-4d56-9524-e750eb74872d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.838612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834b22e-17bd-4d56-9524-e750eb74872d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.852829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1327/2680] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:34:52.858235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:52.872906 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997dbe-8430-43e9-9cc4-5aed0d0e0d60 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:52.879373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:52.880725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.881151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.881563 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] PATH_INFO: `/v3/projects/40c143dbc79640999c3f1764fd72f5a0/users/4729dc08ac3d4c95afb000f1f4eeecd1/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.902840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c143dbc79640999c3f1764fd72f5a0, user_id=4729dc08ac3d4c95afb000f1f4eeecd1, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:52.906217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:52.926056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1354/2681] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:34:52 2022] PUT /identity/v3/projects/40c143dbc79640999c3f1764fd72f5a0/users/4729dc08ac3d4c95afb000f1f4eeecd1/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:52.940644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:52.941202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:52.941580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:52.982748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] MFA Rules not processed for user `4729dc08ac3d4c95afb000f1f4eeecd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:52.984227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:53.076876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1328/2682] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:34:53.084697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.163391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:53.203207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.205693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:53.235144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81628212-47f8-4369-8246-d3846031c3de admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.246166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.247213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.247670 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.248124 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.249271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.252535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.301746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1355/2683] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:34:53 2022] POST /identity/v3/projects => generated 363 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:34:53.308815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.321787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:53.358455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717ff4-bcc9-4901-9f76-c5a4d6b28a94 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.430431 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec57f-2694-4a03-b7a6-a58eb7aa306e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.435546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.436289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.436581 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.436863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.437580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.439641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.473067 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1356/2684] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:34:53 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:34:53.477850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.489112 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645447e-1f0b-4e98-9b8f-ad4e8be27c12 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.497337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.498166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.498463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.499033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.500073 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.502641 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.513635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.515404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.515631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.516055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.518687 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:53.524759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1357/2685] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:34:53.526851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.539338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.541894 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.548726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713904cc-b66d-4adf-a93e-48fd35cf212d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.556449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1329/2686] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:53.561615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.563892 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.564907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.565389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] PATH_INFO: `/v3/projects/ba37d63a343342feade96ee36648e014/users/20bf9bfacae5406daf9d2a625625d367/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.599484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba37d63a343342feade96ee36648e014, user_id=20bf9bfacae5406daf9d2a625625d367, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.605315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.625348 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1358/2687] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:34:53 2022] PUT /identity/v3/projects/ba37d63a343342feade96ee36648e014/users/20bf9bfacae5406daf9d2a625625d367/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:53.630040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.643013 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa2378-eada-4865-9ffd-5360771e547a service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.731342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea04ecb-58c3-462d-b6da-a08ce031cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.732204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea04ecb-58c3-462d-b6da-a08ce031cae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.732562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea04ecb-58c3-462d-b6da-a08ce031cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.732911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea04ecb-58c3-462d-b6da-a08ce031cae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.733719 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea04ecb-58c3-462d-b6da-a08ce031cae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.735520 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea04ecb-58c3-462d-b6da-a08ce031cae8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.748438 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1330/2688] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:34:53.753786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.767973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ae0d-bce0-4e8a-9927-f655a15f2b4c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:53.772804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:53.774055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.774445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.774964 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] PATH_INFO: `/v3/projects/ba37d63a343342feade96ee36648e014/users/20bf9bfacae5406daf9d2a625625d367/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.778680 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba37d63a343342feade96ee36648e014, user_id=20bf9bfacae5406daf9d2a625625d367, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:53.782475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:53.795958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1359/2689] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:34:53 2022] PUT /identity/v3/projects/ba37d63a343342feade96ee36648e014/users/20bf9bfacae5406daf9d2a625625d367/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:34:53.809489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:53.809850 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:53.810209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:53.841810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] MFA Rules not processed for user `20bf9bfacae5406daf9d2a625625d367`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:53.843107 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:53.953530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1331/2690] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:34:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:34:53.968544 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:53.970700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:54.057249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44328cc-8c8d-43fc-95f9-27fd61b6b8b3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:54.061946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:54.062651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:54.062936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:54.063213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:54.073955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:54.079313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:54.082836 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:54.097161 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1360/2691] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:54.184052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:54.189509 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:54.197502 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c5247-d756-4a12-88d2-d9e4c593a9ee None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:54.202668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:54.203411 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:54.203754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:54.204094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:54.295919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:54.297410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:54.308600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1332/2692] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:34:54.576420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:54.578471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:54.650153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b94b3b-3fb3-42a7-9ddb-2b0efbef5019 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:54.654298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:54.654970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:54.655256 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:54.655539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:54.657484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:54.738284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:54.739813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98254c-fdc6-4907-978d-0e7d50819c13 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:54.751317 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1361/2693] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:35:01.731925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:01.747079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99798-98e1-4823-83ca-ac65adeaa034 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:01.759535 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:01.760259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:01.760553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:01.760822 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] PATH_INFO: `/v3/users/4729dc08ac3d4c95afb000f1f4eeecd1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:01.762593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4729dc08ac3d4c95afb000f1f4eeecd1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:01.764994 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:01.842868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4729dc08ac3d4c95afb000f1f4eeecd1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:01.871865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4729dc08ac3d4c95afb000f1f4eeecd1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:01.887181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4729dc08ac3d4c95afb000f1f4eeecd1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:01.888526 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4729dc08ac3d4c95afb000f1f4eeecd1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:01.905263 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4729dc08ac3d4c95afb000f1f4eeecd1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:01.918703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1333/2694] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:01 2022] DELETE /identity/v3/users/4729dc08ac3d4c95afb000f1f4eeecd1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:01.926030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:01.926647 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:01.927042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:01.960743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:01.963072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:02.081069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1362/2695] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:02.094491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:02.097626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:02.238594 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f270bc3-0510-4f5a-a27f-0db425e5df61 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:02.245788 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:02.247032 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:02.247552 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:02.248068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:02.266978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:02.269832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:02.302286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1334/2696] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:02.836828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:02.840220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:02.877221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456632-bf35-4897-9168-9ca94c58ba38 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:02.895413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:02.896955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:02.897452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:02.898125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] PATH_INFO: `/v3/projects/40c143dbc79640999c3f1764fd72f5a0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:02.900557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c143dbc79640999c3f1764fd72f5a0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:02.904970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:02.990100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:03.003631 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c143dbc79640999c3f1764fd72f5a0', 'request_id': 'req-d4a011e9-e899-4c52-a740-6ef47d180eec'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.013377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c143dbc79640999c3f1764fd72f5a0', 'request_id': 'req-d4a011e9-e899-4c52-a740-6ef47d180eec'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.021865 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c143dbc79640999c3f1764fd72f5a0', 'request_id': 'req-d4a011e9-e899-4c52-a740-6ef47d180eec'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.040896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] The token cache is being invalidate because project 40c143dbc79640999c3f1764fd72f5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:03.041301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.042212 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.044516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1363/2697] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:02 2022] DELETE /identity/v3/projects/40c143dbc79640999c3f1764fd72f5a0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:03.048925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:03.062830 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5141ba-d9a9-4588-bba9-1563962b0ec5 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:03.077460 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:03.155265 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:03.156801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:03.157305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:03.157797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] PATH_INFO: `/v3/users/20bf9bfacae5406daf9d2a625625d367` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:03.160311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bf9bfacae5406daf9d2a625625d367)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:03.164201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:03.291895 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bf9bfacae5406daf9d2a625625d367'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.316178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bf9bfacae5406daf9d2a625625d367'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.335349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bf9bfacae5406daf9d2a625625d367'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.336489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bf9bfacae5406daf9d2a625625d367'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.351854 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bf9bfacae5406daf9d2a625625d367'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:03.364345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1335/2698] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:03 2022] DELETE /identity/v3/users/20bf9bfacae5406daf9d2a625625d367 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:04.038572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.041328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:04.066271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a011e9-e899-4c52-a740-6ef47d180eec admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.180019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.181026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.181414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.181855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] PATH_INFO: `/v3/projects/ba37d63a343342feade96ee36648e014` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.183772 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba37d63a343342feade96ee36648e014)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.186711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.239908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.242314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:04.259962 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877934-7c2a-4c80-a99b-4d8ae82d2cd2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.271368 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba37d63a343342feade96ee36648e014', 'request_id': 'req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.279484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba37d63a343342feade96ee36648e014', 'request_id': 'req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.287728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba37d63a343342feade96ee36648e014', 'request_id': 'req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.311007 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] The token cache is being invalidate because project ba37d63a343342feade96ee36648e014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:04.311476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.313424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4c88e539-15e1-4c8f-8a1d-eaa2f2d0dfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.317429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1364/2699] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:04 2022] DELETE /identity/v3/projects/ba37d63a343342feade96ee36648e014 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:04.323989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8afaf-a342-478a-9235-8fe1dff0e243 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.324466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8afaf-a342-478a-9235-8fe1dff0e243 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.324989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8afaf-a342-478a-9235-8fe1dff0e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.344898 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2ac8afaf-a342-478a-9235-8fe1dff0e243 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:04.346185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2ac8afaf-a342-478a-9235-8fe1dff0e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:04.363669 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.366003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.367091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.367587 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] PATH_INFO: `/v3/users/1cbfa6d00f124bd581fbbe67b91c78e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.369918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cbfa6d00f124bd581fbbe67b91c78e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.373692 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.408535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:04.431233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1365/2700] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:04.437425 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.438114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.438895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.452036 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:04.468257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cbfa6d00f124bd581fbbe67b91c78e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.468891 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:04.470664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:04.481737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1366/2701] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:04.485018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cbfa6d00f124bd581fbbe67b91c78e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.488651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.496223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cbfa6d00f124bd581fbbe67b91c78e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.496960 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cbfa6d00f124bd581fbbe67b91c78e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.506407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cbfa6d00f124bd581fbbe67b91c78e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.512819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfc2b4-9f09-46de-a07d-cd176ea9ade5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.519047 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1336/2702] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:04 2022] DELETE /identity/v3/users/1cbfa6d00f124bd581fbbe67b91c78e2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:04.526258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.527384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.529157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.529687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.531728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:35:04.533057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.537198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.566574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1367/2703] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:35:04.572950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.578761 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:04.683864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6cd81-1766-442c-bc58-8833a566a81f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.690209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.691662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.691662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.691662 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.692428 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.695267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.742504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1337/2704] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:04 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:04.744005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.759042 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b888b3d-31f5-45ab-8b2b-2379a4314251 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.767582 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.770864 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:04.862190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.863046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.863505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.863845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.864739 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.867886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.880151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2875-ca15-4911-896b-c84a609626a6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.887494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.888596 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.888984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.889365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] PATH_INFO: `/v3/projects/f5455e547bbd4c8a91a924c0b687a655` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.891100 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5455e547bbd4c8a91a924c0b687a655)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.893774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.894787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1368/2705] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:04 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:04.899469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.912057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabbae-f5a9-4864-bd7e-8ab42e8c22a3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.918064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:04.918896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:04.919320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:04.919728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:04.920685 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:04.923390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:04.938870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1369/2706] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:04.944270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:04.955056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:04.960957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c9810-a68c-4907-bd85-2515b9f45241 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:04.968039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5455e547bbd4c8a91a924c0b687a655', 'request_id': 'req-4e127d8c-f29d-4fb5-a89b-9e890e9190af'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.979220 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5455e547bbd4c8a91a924c0b687a655', 'request_id': 'req-4e127d8c-f29d-4fb5-a89b-9e890e9190af'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:04.990945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5455e547bbd4c8a91a924c0b687a655', 'request_id': 'req-4e127d8c-f29d-4fb5-a89b-9e890e9190af'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.011611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] The token cache is being invalidate because project f5455e547bbd4c8a91a924c0b687a655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:05.012077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.013143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.015771 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1338/2707] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:04 2022] DELETE /identity/v3/projects/f5455e547bbd4c8a91a924c0b687a655 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:05.021603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.024381 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:05.056638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.057564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.057837 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.058307 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.059233 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.061421 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.076200 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1370/2708] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:05.081773 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.083947 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:05.101699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebc963-8d5e-4b71-a9b9-13859e2f6051 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.108990 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e26c9-efc9-4b7c-87ac-ae1a4a435a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.110171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e26c9-efc9-4b7c-87ac-ae1a4a435a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.110521 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e26c9-efc9-4b7c-87ac-ae1a4a435a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.110917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e26c9-efc9-4b7c-87ac-ae1a4a435a88 admin admin] PATH_INFO: `/v3/projects/bd7103d008d8443f8582b4d3bf3c3ec5/users/874a6259e44645b19e60a095fffdbd6c/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.119199 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127d8c-f29d-4fb5-a89b-9e890e9190af admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.125049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.126568 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.127045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.127460 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] PATH_INFO: `/v3/users/8630c22343b24e409deb01bd53559b31` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.129296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8630c22343b24e409deb01bd53559b31)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.131286 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e26c9-efc9-4b7c-87ac-ae1a4a435a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7103d008d8443f8582b4d3bf3c3ec5, user_id=874a6259e44645b19e60a095fffdbd6c, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.131765 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.134575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e26c9-efc9-4b7c-87ac-ae1a4a435a88 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.156245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1371/2709] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:05 2022] PUT /identity/v3/projects/bd7103d008d8443f8582b4d3bf3c3ec5/users/874a6259e44645b19e60a095fffdbd6c/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:05.172661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.173023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.173488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.203768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8630c22343b24e409deb01bd53559b31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.220587 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] MFA Rules not processed for user `874a6259e44645b19e60a095fffdbd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:05.222672 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:05.225308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8630c22343b24e409deb01bd53559b31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.236931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8630c22343b24e409deb01bd53559b31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.237929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8630c22343b24e409deb01bd53559b31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.253259 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8630c22343b24e409deb01bd53559b31'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.255888 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:05.264023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1339/2710] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:05 2022] DELETE /identity/v3/users/8630c22343b24e409deb01bd53559b31 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:05.328848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1372/2711] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:05.335193 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.336831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:05.406668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:05.438931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ef58a-f87a-49ed-bdca-43a32ce8855b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.445106 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.445874 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.446345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.446776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.447947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.450433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.486721 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1340/2712] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:05 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:35:05.495854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.523561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.526584 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:05.595415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf7e08-704c-41e4-a016-29ca5882e4f1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.624836 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e788-89ac-45fa-b461-2956207251b8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.630863 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.632045 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.632440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.632915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] PATH_INFO: `/v3/projects/756b06bdb90243f9a53bc78f4f15641d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.634583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=756b06bdb90243f9a53bc78f4f15641d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.636927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.663360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.664550 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.664827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.665099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.665800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.667819 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.691448 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1373/2713] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:05 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:05.696222 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.697648 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756b06bdb90243f9a53bc78f4f15641d', 'request_id': 'req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.705084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756b06bdb90243f9a53bc78f4f15641d', 'request_id': 'req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.707711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade216a-ebf7-4f46-b028-c54c43778602 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.713178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756b06bdb90243f9a53bc78f4f15641d', 'request_id': 'req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.732079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] The token cache is being invalidate because project 756b06bdb90243f9a53bc78f4f15641d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:05.732550 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.733540 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:05.735798 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1341/2714] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:05 2022] DELETE /identity/v3/projects/756b06bdb90243f9a53bc78f4f15641d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:05.795074 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:05.804657 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.805746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.806187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.806480 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.807558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.809538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.821922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1374/2715] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:05.832665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.834633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:05.850437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6bf9-e742-4d4e-89c5-551f2bafa10f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.858847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.860011 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.860479 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.860868 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] PATH_INFO: `/v3/projects/4b443b7ba8a34dd0a0117b5e1bd8648f/users/12675a81ae824f97909136389b4381de/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.881523 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b443b7ba8a34dd0a0117b5e1bd8648f, user_id=12675a81ae824f97909136389b4381de, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.885039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:05.901794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1342/2716] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:05 2022] PUT /identity/v3/projects/4b443b7ba8a34dd0a0117b5e1bd8648f/users/12675a81ae824f97909136389b4381de/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:05.906615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:05.919413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852222a1-b3c1-415d-94f9-c8d1025ae34f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:05.990039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81027d-108c-4ae8-8296-68a5ed99f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:05.990738 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81027d-108c-4ae8-8296-68a5ed99f7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:05.991024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81027d-108c-4ae8-8296-68a5ed99f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:05.991302 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81027d-108c-4ae8-8296-68a5ed99f7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:05.992637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81027d-108c-4ae8-8296-68a5ed99f7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:05.994384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81027d-108c-4ae8-8296-68a5ed99f7a6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:06.006397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1375/2717] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:06.010879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:06.022394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b71ff-a0a2-49f2-87e5-368748e9c020 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:06.027676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:06.028603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:06.028884 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:06.029158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] PATH_INFO: `/v3/projects/4b443b7ba8a34dd0a0117b5e1bd8648f/users/12675a81ae824f97909136389b4381de/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:06.031489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b443b7ba8a34dd0a0117b5e1bd8648f, user_id=12675a81ae824f97909136389b4381de, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:06.034401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:06.046475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1343/2718] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:06 2022] PUT /identity/v3/projects/4b443b7ba8a34dd0a0117b5e1bd8648f/users/12675a81ae824f97909136389b4381de/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:06.057452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:06.058080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:06.058080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:06.087826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] MFA Rules not processed for user `12675a81ae824f97909136389b4381de`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:06.089066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:06.175306 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1376/2719] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:06.188286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:06.190168 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:06.225212 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:06.258376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296921-7edd-433b-b7ed-796e5e045402 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:06.262670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:06.263342 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:06.263622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:06.263893 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:06.265753 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:06.335826 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:06.337451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:06.347944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1344/2720] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:08.994696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:09.005424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cf5d8-ebab-4d70-825e-3e3c5395497f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:09.009872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c80a-ce2f-4064-8a00-0e54b42c7fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:09.010598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c80a-ce2f-4064-8a00-0e54b42c7fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:09.010881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c80a-ce2f-4064-8a00-0e54b42c7fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:09.011162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c80a-ce2f-4064-8a00-0e54b42c7fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:09.022118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365c80a-ce2f-4064-8a00-0e54b42c7fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:09.023807 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365c80a-ce2f-4064-8a00-0e54b42c7fa6 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:09.035991 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1377/2721] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:35:16.344066 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=36 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:19.030839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=72 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:22.108555 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:22.183480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ef425-3094-4de1-9894-befb1eecb39e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:22.188376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:22.189269 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:22.189553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:22.189828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] PATH_INFO: `/v3/users/874a6259e44645b19e60a095fffdbd6c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:22.191139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=874a6259e44645b19e60a095fffdbd6c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:22.193095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:22.261453 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874a6259e44645b19e60a095fffdbd6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.278039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874a6259e44645b19e60a095fffdbd6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.289312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874a6259e44645b19e60a095fffdbd6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.290262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874a6259e44645b19e60a095fffdbd6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.300817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874a6259e44645b19e60a095fffdbd6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.312223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1345/2722] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:22 2022] DELETE /identity/v3/users/874a6259e44645b19e60a095fffdbd6c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:22.316886 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:22.317435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:22.317583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:22.337536 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:22.338712 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:22.405478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1378/2723] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:22.417111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:22.418574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:22.480290 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba5f8-0117-4f9c-8751-e80e0c5d5dba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:22.484197 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:22.484871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:22.485144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:22.485421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:22.499661 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:22.501128 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:22.512427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1346/2724] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:22.798461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:22.800230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:22.814454 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6641e4-149f-4acd-86c3-3d4bedadbeb9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:22.820718 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:22.821774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:22.822857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:22.822857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] PATH_INFO: `/v3/projects/bd7103d008d8443f8582b4d3bf3c3ec5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:22.823964 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7103d008d8443f8582b4d3bf3c3ec5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:22.828040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:22.886917 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7103d008d8443f8582b4d3bf3c3ec5', 'request_id': 'req-b90c8d67-8761-4cda-9331-e0ba80cefa74'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.893916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7103d008d8443f8582b4d3bf3c3ec5', 'request_id': 'req-b90c8d67-8761-4cda-9331-e0ba80cefa74'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.900654 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7103d008d8443f8582b4d3bf3c3ec5', 'request_id': 'req-b90c8d67-8761-4cda-9331-e0ba80cefa74'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.914262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] The token cache is being invalidate because project bd7103d008d8443f8582b4d3bf3c3ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:22.914615 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.915223 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:22.916956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1379/2725] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:22 2022] DELETE /identity/v3/projects/bd7103d008d8443f8582b4d3bf3c3ec5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:22.922064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:22.940401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08363b-6679-4969-8f52-3d7b8d84ea67 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:22.975345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:23.025802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:23.026845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.027252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.027612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] PATH_INFO: `/v3/users/12675a81ae824f97909136389b4381de` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.028981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12675a81ae824f97909136389b4381de)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:23.031217 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:23.089901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12675a81ae824f97909136389b4381de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.112252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12675a81ae824f97909136389b4381de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.120829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12675a81ae824f97909136389b4381de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.121744 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12675a81ae824f97909136389b4381de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.130714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b906017f-36cc-443e-8e29-0b150c022c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12675a81ae824f97909136389b4381de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.139796 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1347/2726] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:22 2022] DELETE /identity/v3/users/12675a81ae824f97909136389b4381de => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:23.478494 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:23.480562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:23.497316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8d67-8761-4cda-9331-e0ba80cefa74 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:23.572890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:23.573745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.574052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.574328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] PATH_INFO: `/v3/projects/4b443b7ba8a34dd0a0117b5e1bd8648f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.575928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b443b7ba8a34dd0a0117b5e1bd8648f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:23.578075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:23.613400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:23.634281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b443b7ba8a34dd0a0117b5e1bd8648f', 'request_id': 'req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.641033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b443b7ba8a34dd0a0117b5e1bd8648f', 'request_id': 'req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.647108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b443b7ba8a34dd0a0117b5e1bd8648f', 'request_id': 'req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.661533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] The token cache is being invalidate because project 4b443b7ba8a34dd0a0117b5e1bd8648f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:23.661755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.662444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f22f40ac-2187-477b-b9aa-10f9ee3a20fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:23.664060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1380/2727] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:23 2022] DELETE /identity/v3/projects/4b443b7ba8a34dd0a0117b5e1bd8648f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:23.669450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.669829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.670144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.688287 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:23.689489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:23.754908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1348/2728] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:23.765171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.765461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.765744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.786099 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:23.787337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:23.796280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1381/2729] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:23.800718 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:23.812041 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4fd38-f5e0-46f3-81e2-4c7b37d94339 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:23.816978 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:23.817670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.818003 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.818436 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.819206 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:35:23.820171 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:23.821869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:23.836938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1349/2730] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:35:23.841518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:23.851776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c685eb-a6ef-421f-9829-7c08cf1ac04e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:23.856704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:23.857384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.857665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.857941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.858681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:23.860642 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:23.890785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1382/2731] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:23 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:23.897452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:23.908634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6de158-3e96-4f62-a819-550bc8d3337f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:23.940575 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:23.979926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:23.980631 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:23.980920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:23.981196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:23.981918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:23.984002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.008427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1350/2732] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:23 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:35:24.014774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.031361 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc16139-53ca-4454-9343-312dbb1658e4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.039114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.040136 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.040567 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.040985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.042236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.045045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.064681 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1383/2733] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:24.069139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.080233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a13f25-f664-48fa-a1aa-5b7984f3515e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.085320 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b479a8-0352-4700-9912-a614207f768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.086046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b479a8-0352-4700-9912-a614207f768c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.086330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b479a8-0352-4700-9912-a614207f768c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.086601 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b479a8-0352-4700-9912-a614207f768c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.087328 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b479a8-0352-4700-9912-a614207f768c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.088969 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b479a8-0352-4700-9912-a614207f768c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.100385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1351/2734] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:24.107844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.126885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ee89-599e-471e-8575-a271d11e840f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.136236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.137821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.138358 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.138851 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] PATH_INFO: `/v3/projects/827c0dc81d1c414faf04a4420c8e59b9/users/d9901a2de8494abba2df558f5d88f3e7/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.166746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827c0dc81d1c414faf04a4420c8e59b9, user_id=d9901a2de8494abba2df558f5d88f3e7, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.172405 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.196602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1384/2735] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:24 2022] PUT /identity/v3/projects/827c0dc81d1c414faf04a4420c8e59b9/users/d9901a2de8494abba2df558f5d88f3e7/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:24.214872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.215423 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.215541 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.246801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] MFA Rules not processed for user `d9901a2de8494abba2df558f5d88f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:24.248055 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:24.317183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1352/2736] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:24.321976 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.394658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c435-d2b5-4d2d-9acf-ded9cb539344 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.400253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.401057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.401449 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.401824 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.402752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.404785 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.434166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1385/2737] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:24 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:24.438773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.451663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b6837-e3d3-4e95-8f8a-b3c8c5a95179 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.520158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.520925 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.521262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.521580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.522881 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.524905 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.548832 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1353/2738] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:24 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:24.553153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.564468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c37e8-a0d4-4712-9be2-60c094aea28e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.569574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.570330 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.570572 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.570859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.571585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.573236 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.586381 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1386/2739] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:24.591157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.603332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf3e7-7084-462b-946b-7620b9e4b78d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.608578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.609491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.609773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.610081 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] PATH_INFO: `/v3/projects/05e6147b160e421ba4ead55bf657870f/users/5e591f4afcb5482882d64ced10409e79/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.626521 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e6147b160e421ba4ead55bf657870f, user_id=5e591f4afcb5482882d64ced10409e79, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.629223 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.645018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1354/2740] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:24 2022] PUT /identity/v3/projects/05e6147b160e421ba4ead55bf657870f/users/5e591f4afcb5482882d64ced10409e79/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:24.650015 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.661036 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24a618-60e8-4f14-92db-949b40bb2c5c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.697178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:24.740805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1afd4-4f02-4d3c-a9e3-dcc17c8fe12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.741432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1afd4-4f02-4d3c-a9e3-dcc17c8fe12a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.741716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1afd4-4f02-4d3c-a9e3-dcc17c8fe12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.742024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1afd4-4f02-4d3c-a9e3-dcc17c8fe12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.742770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1afd4-4f02-4d3c-a9e3-dcc17c8fe12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.744427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1afd4-4f02-4d3c-a9e3-dcc17c8fe12a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.755527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1387/2741] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:24.760630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.766776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:24.775976 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a0a3a-0fcf-4cfe-bc93-340d3e1f9675 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:24.782469 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:24.783676 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.784035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.784515 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] PATH_INFO: `/v3/projects/05e6147b160e421ba4ead55bf657870f/users/5e591f4afcb5482882d64ced10409e79/roles/d0122fde930842079d42ce76139767e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.786929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e6147b160e421ba4ead55bf657870f, user_id=5e591f4afcb5482882d64ced10409e79, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:24.790312 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:24.807679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1355/2742] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:24 2022] PUT /identity/v3/projects/05e6147b160e421ba4ead55bf657870f/users/5e591f4afcb5482882d64ced10409e79/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:24.820728 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:24.821004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:24.821278 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:24.863493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] MFA Rules not processed for user `5e591f4afcb5482882d64ced10409e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:24.864811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:24.944605 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1388/2743] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:24.956752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:24.958629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:25.023799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1f8cf-212f-4e51-9142-5a310d11efc2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:25.027961 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d373-40cc-4657-8b67-e874606c7c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:25.028633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d373-40cc-4657-8b67-e874606c7c0b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:25.028917 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d373-40cc-4657-8b67-e874606c7c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:25.029195 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d373-40cc-4657-8b67-e874606c7c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:25.040160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d373-40cc-4657-8b67-e874606c7c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:25.041591 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d373-40cc-4657-8b67-e874606c7c0b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:25.052255 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1356/2744] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:25.096424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:25.182938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669d604-eaf0-472a-affa-96206aadd166 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:25.188030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:25.188940 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:25.189227 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:25.189504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] PATH_INFO: `/v3/users/d9901a2de8494abba2df558f5d88f3e7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:25.190908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9901a2de8494abba2df558f5d88f3e7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:25.192876 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:25.247778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9901a2de8494abba2df558f5d88f3e7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:25.248584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9901a2de8494abba2df558f5d88f3e7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:25.250199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:25.259250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9901a2de8494abba2df558f5d88f3e7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:25.268958 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9901a2de8494abba2df558f5d88f3e7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:25.284882 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9901a2de8494abba2df558f5d88f3e7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:25.292427 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1389/2745] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:25 2022] DELETE /identity/v3/users/d9901a2de8494abba2df558f5d88f3e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:25.297678 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:25.298368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:25.298368 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:25.318855 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:25.320784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:25.397902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1357/2746] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:25.409922 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:25.411511 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:25.478547 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca4f85-1c25-4966-8926-7cf7c08228f2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:25.482570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:25.483244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:25.483534 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:25.483812 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:25.496221 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:25.497579 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:25.509566 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1390/2747] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:35:25.898980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:25.901272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:25.919380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e806-5fe0-4698-97e9-2dc3185aeeed None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:25.925466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:25.926634 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:25.927080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:25.927440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] PATH_INFO: `/v3/projects/827c0dc81d1c414faf04a4420c8e59b9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:25.929534 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827c0dc81d1c414faf04a4420c8e59b9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:25.931828 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:25.995578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827c0dc81d1c414faf04a4420c8e59b9', 'request_id': 'req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.002511 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827c0dc81d1c414faf04a4420c8e59b9', 'request_id': 'req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.010915 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827c0dc81d1c414faf04a4420c8e59b9', 'request_id': 'req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.026336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] The token cache is being invalidate because project 827c0dc81d1c414faf04a4420c8e59b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:26.026728 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.028385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.029600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1358/2748] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:25 2022] DELETE /identity/v3/projects/827c0dc81d1c414faf04a4420c8e59b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:26.034105 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:26.045462 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81253d-02ec-4e80-b960-f69f873ba943 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:26.117093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:26.118108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:26.118444 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:26.118769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] PATH_INFO: `/v3/users/5e591f4afcb5482882d64ced10409e79` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:26.120195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e591f4afcb5482882d64ced10409e79)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:26.122726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:26.178884 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e591f4afcb5482882d64ced10409e79'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.179500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e591f4afcb5482882d64ced10409e79'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.187397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e591f4afcb5482882d64ced10409e79'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.196639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e591f4afcb5482882d64ced10409e79'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.206428 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:26.217206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-dad960c1-3927-4b9b-84ba-e87fc7837680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e591f4afcb5482882d64ced10409e79'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.224400 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1391/2749] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:26 2022] DELETE /identity/v3/users/5e591f4afcb5482882d64ced10409e79 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:26.567158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:26.568782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:26.592646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f30a8-69d7-4e4e-a094-51fc99b89dd4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:26.613670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:26.693566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:26.695056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:26.695339 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:26.695612 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] PATH_INFO: `/v3/projects/05e6147b160e421ba4ead55bf657870f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:26.696876 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e6147b160e421ba4ead55bf657870f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:26.698871 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:26.757739 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e6147b160e421ba4ead55bf657870f', 'request_id': 'req-45c0f006-7635-4e5a-8357-c3f5ea33262e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.764429 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e6147b160e421ba4ead55bf657870f', 'request_id': 'req-45c0f006-7635-4e5a-8357-c3f5ea33262e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.772507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e6147b160e421ba4ead55bf657870f', 'request_id': 'req-45c0f006-7635-4e5a-8357-c3f5ea33262e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.787335 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] The token cache is being invalidate because project 05e6147b160e421ba4ead55bf657870f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:26.787649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.788376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-45c0f006-7635-4e5a-8357-c3f5ea33262e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:26.790422 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1359/2750] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:26 2022] DELETE /identity/v3/projects/05e6147b160e421ba4ead55bf657870f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:26.795949 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:26.796357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:26.796763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:26.817877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:26.819170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:26.892141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1392/2751] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:26.901202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:26.901574 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:26.901920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:26.922142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:26.923395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:26.932627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1360/2752] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:26.939600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:26.957667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316781-e46c-4237-a8c7-18c19cc4d8e2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:26.965598 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:26.967101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:26.967438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:26.967815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:26.968614 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:35:26.968970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:26.970827 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:26.984766 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1393/2753] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:35:26.989590 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.000433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf6464-671e-44d6-a074-1e813c23371f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.005330 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.006039 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.006329 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.006633 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.007370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.009383 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.037797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1361/2754] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:27.043319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.056091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0b77-48b8-49c9-9bee-394f695a12d6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.123414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.124110 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.124396 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.124676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.125376 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.127552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.149715 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1394/2755] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:27 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:27.154454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.166386 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6170d18-f68a-4566-8697-4ad851beed9f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.171672 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.172364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.172649 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.172968 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.173705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.175376 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.189746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1362/2756] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:27.194070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.205383 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f5c12-a8ed-4c56-b817-68fe3b9e3f4b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.211271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09137-f864-4f2c-bfde-50a9c60d527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.212334 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09137-f864-4f2c-bfde-50a9c60d527b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.212729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09137-f864-4f2c-bfde-50a9c60d527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.213158 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09137-f864-4f2c-bfde-50a9c60d527b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.214052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09137-f864-4f2c-bfde-50a9c60d527b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.215817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09137-f864-4f2c-bfde-50a9c60d527b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.228241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1395/2757] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:27.234652 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.249763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d198bd5-837d-4371-91b0-da13793871e7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.259046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.260799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.261188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.261784 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] PATH_INFO: `/v3/projects/c91cde691e0f470186b3fa8e95e0c50d/users/0332fecb701d4444bf1862d2862cbac8/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.285056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91cde691e0f470186b3fa8e95e0c50d, user_id=0332fecb701d4444bf1862d2862cbac8, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.288336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.305867 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1363/2758] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:27 2022] PUT /identity/v3/projects/c91cde691e0f470186b3fa8e95e0c50d/users/0332fecb701d4444bf1862d2862cbac8/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:27.317373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.317656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.317928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.349609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] MFA Rules not processed for user `0332fecb701d4444bf1862d2862cbac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:27.350962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:27.402210 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:27.432157 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1396/2759] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:27.437157 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.490468 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:27.516364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa41f-d899-4485-85e4-ad9b064c37ee admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.521172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.521857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.522176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.523276 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.524595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.528353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.569840 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1364/2760] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:27 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:35:27.574382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.587798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9cde-0b4a-47b2-9498-bce85ad8815d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.660780 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.662002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.662530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.663667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.664948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.668580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.702024 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1397/2761] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:27 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:27.707980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.726477 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9389289-1fcb-4192-bd64-d6df0d86d582 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.734613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.735777 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.736272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.736764 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.738179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.741398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.762998 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1365/2762] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:27.767778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.779292 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700c159-c085-456d-95d2-4adf9cce5a55 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.784628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f72e4-3bae-49ca-84a1-56c029f44a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.785433 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f72e4-3bae-49ca-84a1-56c029f44a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.785755 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f72e4-3bae-49ca-84a1-56c029f44a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.786123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f72e4-3bae-49ca-84a1-56c029f44a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.786914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f72e4-3bae-49ca-84a1-56c029f44a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.788745 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f72e4-3bae-49ca-84a1-56c029f44a00 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.800786 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1398/2763] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:27.805671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:27.816732 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8900f-10e3-4439-8e42-ef20f7159367 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:27.822536 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:27.823602 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.823974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.824684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] PATH_INFO: `/v3/projects/65dafadc2f26480ba16fc06921e4d8c6/users/38f58589231947688be942a0d701723c/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.847196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65dafadc2f26480ba16fc06921e4d8c6, user_id=38f58589231947688be942a0d701723c, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:27.850030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:27.867794 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1366/2764] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:27 2022] PUT /identity/v3/projects/65dafadc2f26480ba16fc06921e4d8c6/users/38f58589231947688be942a0d701723c/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:27.880005 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:27.880424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:27.880805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:27.911904 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] MFA Rules not processed for user `38f58589231947688be942a0d701723c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:27.913349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:28.001384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1399/2765] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:28.007553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.080402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2fea-98a7-4811-8545-597d8865132c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.085425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.086233 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.086566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.086896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.087646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.089673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.120119 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1367/2766] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:28 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:28.124848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.143900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5948d-8428-4676-8447-06a299d34e1b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.198570 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:28.210538 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.211246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.211549 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.211787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.212491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.214573 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.238207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1400/2767] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:28 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:35:28.243348 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.259889 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384541b4-0de5-4fb1-8c63-90df89789187 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.268849 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.270094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.270624 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.271123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.272531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.275806 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.298048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1368/2768] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:28.303245 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.314445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea6198-74d7-4699-9e16-7d97a347cef4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.320071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.320989 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.321268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.321535 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] PATH_INFO: `/v3/projects/aac0d0b9eb944506b8b0a30a4d19a49f/users/ab80548b21bc44a2afb805ed19364de7/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.338946 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac0d0b9eb944506b8b0a30a4d19a49f, user_id=ab80548b21bc44a2afb805ed19364de7, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.341840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.356560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1401/2769] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:28 2022] PUT /identity/v3/projects/aac0d0b9eb944506b8b0a30a4d19a49f/users/ab80548b21bc44a2afb805ed19364de7/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:28.360787 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.371944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ad3dc-0071-4952-9e7f-61c7761ea69e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.436694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b990-ebe2-462f-9d64-dba787d6bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.437373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b990-ebe2-462f-9d64-dba787d6bda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.437650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b990-ebe2-462f-9d64-dba787d6bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.437922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b990-ebe2-462f-9d64-dba787d6bda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.438679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b990-ebe2-462f-9d64-dba787d6bda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.440305 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b990-ebe2-462f-9d64-dba787d6bda3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.451638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1369/2770] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:28.456072 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.466893 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978105-072e-4506-bf02-52ffe1eec2a7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.471754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.472669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.472942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.473303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] PATH_INFO: `/v3/projects/aac0d0b9eb944506b8b0a30a4d19a49f/users/ab80548b21bc44a2afb805ed19364de7/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.475921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac0d0b9eb944506b8b0a30a4d19a49f, user_id=ab80548b21bc44a2afb805ed19364de7, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.478792 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.490737 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1402/2771] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:28 2022] PUT /identity/v3/projects/aac0d0b9eb944506b8b0a30a4d19a49f/users/ab80548b21bc44a2afb805ed19364de7/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:28.556776 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.557060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.557350 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.563414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:28.588793 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] MFA Rules not processed for user `ab80548b21bc44a2afb805ed19364de7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:28.590604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:28.671911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1370/2772] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:28.684367 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:28.686489 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:28.758928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac02b4-1100-4657-8a4b-9d75f7056740 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:28.763622 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:28.764430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:28.764815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:28.765184 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:28.777029 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:28.778860 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:28.791275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1403/2773] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:35:29.361235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:29.362657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:29.380473 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef4a74-b268-4df4-bfd3-563a9b604fe4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:29.387491 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:29.388814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:29.389314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:29.389801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:29.461539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:29.463044 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:29.473391 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1371/2774] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:33.965372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:33.976466 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb471a0-5b38-43a2-8a3a-c0d91b31c4bc service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:33.981030 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33879a-e070-4bd7-b7e9-0029cd17135e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:33.981630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33879a-e070-4bd7-b7e9-0029cd17135e service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:33.981913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33879a-e070-4bd7-b7e9-0029cd17135e service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:33.982229 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33879a-e070-4bd7-b7e9-0029cd17135e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:34.052398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33879a-e070-4bd7-b7e9-0029cd17135e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:34.054921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33879a-e070-4bd7-b7e9-0029cd17135e service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:34.064802 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1404/2775] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:36.744340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:36.841268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:36.859899 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0af141-258d-4600-8ef4-7616b149f183 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:36.864626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:36.865503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:36.865782 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:36.866749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] PATH_INFO: `/v3/users/0332fecb701d4444bf1862d2862cbac8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:36.868425 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0332fecb701d4444bf1862d2862cbac8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:36.871410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:36.943657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0332fecb701d4444bf1862d2862cbac8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:36.962445 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0332fecb701d4444bf1862d2862cbac8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:36.971797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0332fecb701d4444bf1862d2862cbac8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:36.972581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0332fecb701d4444bf1862d2862cbac8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:36.982155 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0332fecb701d4444bf1862d2862cbac8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:36.989034 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1372/2776] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:36 2022] DELETE /identity/v3/users/0332fecb701d4444bf1862d2862cbac8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:36.994857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:36.995744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:36.995744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:37.052788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:37.054097 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:37.071251 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:37.161518 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1405/2777] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:37.172641 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:37.175023 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:37.330831 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239c754-2573-4c93-9121-52fa251aaa62 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:37.334698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:37.335373 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:37.335657 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:37.335945 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:37.346786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:37.348251 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:37.359400 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1373/2778] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:37.766013 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:37.769467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:37.784066 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d1bbe-5f38-4a13-9e1d-a065b5fc2a10 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:37.791628 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:37.792918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:37.793384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:37.793771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] PATH_INFO: `/v3/projects/c91cde691e0f470186b3fa8e95e0c50d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:37.795393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91cde691e0f470186b3fa8e95e0c50d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:37.797468 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:37.861823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91cde691e0f470186b3fa8e95e0c50d', 'request_id': 'req-fe09a65f-5eba-4919-9f96-61028f2a8439'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:37.868889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91cde691e0f470186b3fa8e95e0c50d', 'request_id': 'req-fe09a65f-5eba-4919-9f96-61028f2a8439'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:37.875890 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91cde691e0f470186b3fa8e95e0c50d', 'request_id': 'req-fe09a65f-5eba-4919-9f96-61028f2a8439'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:37.890541 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] The token cache is being invalidate because project c91cde691e0f470186b3fa8e95e0c50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:37.890826 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:37.891474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:37.893070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1406/2779] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:37 2022] DELETE /identity/v3/projects/c91cde691e0f470186b3fa8e95e0c50d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:37.898026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:37.909781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48030c-2136-4a6a-b74b-4d74bc29510a service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:37.948115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:38.007931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:38.009380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:38.009878 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:38.010443 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] PATH_INFO: `/v3/users/38f58589231947688be942a0d701723c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:38.012921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f58589231947688be942a0d701723c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:38.015454 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:38.092921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f58589231947688be942a0d701723c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.111501 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f58589231947688be942a0d701723c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.121651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f58589231947688be942a0d701723c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.122358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f58589231947688be942a0d701723c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.133028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f58589231947688be942a0d701723c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.145064 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1374/2780] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:37 2022] DELETE /identity/v3/users/38f58589231947688be942a0d701723c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:38.477432 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:38.479088 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:38.497138 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a65f-5eba-4919-9f96-61028f2a8439 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:38.601793 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:38.603476 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:38.603941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:38.604417 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] PATH_INFO: `/v3/projects/65dafadc2f26480ba16fc06921e4d8c6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:38.607033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65dafadc2f26480ba16fc06921e4d8c6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:38.611022 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:38.693623 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:38.701732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65dafadc2f26480ba16fc06921e4d8c6', 'request_id': 'req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.710845 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65dafadc2f26480ba16fc06921e4d8c6', 'request_id': 'req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.723562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65dafadc2f26480ba16fc06921e4d8c6', 'request_id': 'req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.748478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] The token cache is being invalidate because project 65dafadc2f26480ba16fc06921e4d8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:38.749075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.750319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.756320 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1407/2781] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:38 2022] DELETE /identity/v3/projects/65dafadc2f26480ba16fc06921e4d8c6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:38.758433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:38.760094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:38.776580 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd9685-eaba-4026-814d-e95b04e391e7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:38.861581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:38.862824 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:38.863487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:38.863872 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] PATH_INFO: `/v3/users/ab80548b21bc44a2afb805ed19364de7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:38.865578 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab80548b21bc44a2afb805ed19364de7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:38.869401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:38.970141 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab80548b21bc44a2afb805ed19364de7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:38.981907 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:39.000401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab80548b21bc44a2afb805ed19364de7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.015979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab80548b21bc44a2afb805ed19364de7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.017067 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab80548b21bc44a2afb805ed19364de7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.035398 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e955e3ff-f80d-4b36-a39a-9c0c3999a3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab80548b21bc44a2afb805ed19364de7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.047716 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1375/2782] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:38 2022] DELETE /identity/v3/users/ab80548b21bc44a2afb805ed19364de7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:39.572197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:39.574934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:39.609372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6ea25-38f5-4a0a-97dd-9f29ab0b4a3d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:39.716913 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:39.718343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:39.719699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:39.720206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] PATH_INFO: `/v3/projects/aac0d0b9eb944506b8b0a30a4d19a49f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:39.722457 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac0d0b9eb944506b8b0a30a4d19a49f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:39.724561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:39.802708 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac0d0b9eb944506b8b0a30a4d19a49f', 'request_id': 'req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.810558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac0d0b9eb944506b8b0a30a4d19a49f', 'request_id': 'req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.817014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac0d0b9eb944506b8b0a30a4d19a49f', 'request_id': 'req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.833071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] The token cache is being invalidate because project aac0d0b9eb944506b8b0a30a4d19a49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:39.833359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.834055 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d3e00ea2-c30f-4944-9ae8-7ae631a5c4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:39.836235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1408/2783] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:39 2022] DELETE /identity/v3/projects/aac0d0b9eb944506b8b0a30a4d19a49f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:39.842883 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:39.843321 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:39.843714 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:39.906042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:39.908224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:40.030030 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1376/2784] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:40.039543 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.039811 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.040081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.059522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:40.060750 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:40.068866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1409/2785] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:35:40.073441 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.083869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ebfec-72bf-497b-aab6-d120779ab661 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.090570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.091267 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.091553 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.091918 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.092665 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:35:40.093038 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.094699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.108982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1377/2786] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:35:40.113505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.123855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60f9c-5418-438f-80a6-5e620f6b9bf8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.139262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8d654-2d18-4a70-8b68-a1e9b66af1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.139262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d654-2d18-4a70-8b68-a1e9b66af1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.139262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d654-2d18-4a70-8b68-a1e9b66af1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.139262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d654-2d18-4a70-8b68-a1e9b66af1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.139907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8d654-2d18-4a70-8b68-a1e9b66af1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.139907 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8d654-2d18-4a70-8b68-a1e9b66af1c8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.181191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1410/2787] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:35:40 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:40.186026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.197187 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263ec50-f527-4284-b559-1264d6794af4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.207877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.208323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.208699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.234484 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] MFA Rules not processed for user `6af8f930d4e94212896840b336e6f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:40.236262 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:40.269610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.270344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.270622 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.270896 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.271607 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.274145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.274556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:40.304870 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1378/2788] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:35:40 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:35:40.308244 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1411/2789] 10.222.0.61 () {58 vars in 967 bytes} [Fri May 27 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:40.309566 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.322627 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dbe0a-cc7f-4aca-97a3-28271418c132 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.328120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.328810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.329088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.329357 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.330148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.331817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.346025 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1379/2790] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:35:40.349867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.362379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d465-51af-4fbe-9fd4-fe19f6c1a5e9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.369775 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.370927 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.371413 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.371914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.373576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.376625 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.393496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.396213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:40.402271 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1412/2791] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:35:40.403776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.418612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d85eb-848f-4fbc-afaa-d178dd8aa90b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.423941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae268e-3c49-45b4-87b8-5d33a8978ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.424967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae268e-3c49-45b4-87b8-5d33a8978ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.425231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae268e-3c49-45b4-87b8-5d33a8978ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.425507 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae268e-3c49-45b4-87b8-5d33a8978ac7 admin admin] PATH_INFO: `/v3/projects/e278ba71423145b99dee86814b26e23e/users/ea6315e57f3a434898b7df0642775227/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.444195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae268e-3c49-45b4-87b8-5d33a8978ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e278ba71423145b99dee86814b26e23e, user_id=ea6315e57f3a434898b7df0642775227, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.444858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:40.447078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae268e-3c49-45b4-87b8-5d33a8978ac7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.464488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1413/2792] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:35:40 2022] PUT /identity/v3/projects/e278ba71423145b99dee86814b26e23e/users/ea6315e57f3a434898b7df0642775227/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:35:40.480162 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.480537 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.481085 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.533315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] MFA Rules not processed for user `ea6315e57f3a434898b7df0642775227`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:35:40.535178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:40.535879 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558be8c-44e6-48bc-a69a-6821c9f58917 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.622408 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'effdc345daee49d8ad4a09f2dd6fd40e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.623073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.623353 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.623628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.655583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1414/2793] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:35:40.667758 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:40.669640 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:40.700629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.703297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.714091 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1380/2794] 10.222.0.61 () {60 vars in 1384 bytes} [Fri May 27 03:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 03:35:40.749736 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4f78-cf28-4a20-99f5-60f68de42bf1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:40.755938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:40.757691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:40.758206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:40.758508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:40.772996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:40.775813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:40.788479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1415/2795] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:35:45.564049 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:45.566666 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:45.801927 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86efe9b-7dbe-4547-8e9e-ad74184a4c01 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:45.812296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:45.814169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:45.814378 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:45.815296 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:45.820869 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:45.839209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:45.847530 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:45.849505 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:45.864308 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1381/2796] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:35:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:35:50.457213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:50.459675 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:50.547104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:50.612260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77c52a-9940-43a3-b6af-63e993fe2da7 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:50.622430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:50.624047 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:50.624545 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:50.625023 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] PATH_INFO: `/v3/users/8cc1ba0c0b6a4fffb775c1ab62e73360` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:50.627908 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc1ba0c0b6a4fffb775c1ab62e73360)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:50.632975 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:50.759485 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc1ba0c0b6a4fffb775c1ab62e73360'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:50.760471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc1ba0c0b6a4fffb775c1ab62e73360'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:50.772453 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc1ba0c0b6a4fffb775c1ab62e73360'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:50.785109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc1ba0c0b6a4fffb775c1ab62e73360'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:50.804869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc1ba0c0b6a4fffb775c1ab62e73360'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:50.813056 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1416/2797] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:50 2022] DELETE /identity/v3/users/8cc1ba0c0b6a4fffb775c1ab62e73360 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:51.118766 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:51.139111 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82efa-5419-466c-b243-6994277a4812 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:51.247768 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:51.248735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:51.249131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:51.249774 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] PATH_INFO: `/v3/projects/720658bab13b482abce02d83d87f29e6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:51.252224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720658bab13b482abce02d83d87f29e6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:51.256176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:51.334297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720658bab13b482abce02d83d87f29e6', 'request_id': 'req-5de9abab-5e22-4b62-b5c9-e9071dfc0183'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.345760 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720658bab13b482abce02d83d87f29e6', 'request_id': 'req-5de9abab-5e22-4b62-b5c9-e9071dfc0183'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.360351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720658bab13b482abce02d83d87f29e6', 'request_id': 'req-5de9abab-5e22-4b62-b5c9-e9071dfc0183'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.381506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] The token cache is being invalidate because project 720658bab13b482abce02d83d87f29e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:51.382544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.383659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.386080 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1382/2798] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:51 2022] DELETE /identity/v3/projects/720658bab13b482abce02d83d87f29e6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:51.393402 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:51.395936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:51.421250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9078-f73a-4f2a-9545-27dca34cdfe3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:51.522627 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:51.523813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:51.523813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:51.524148 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] PATH_INFO: `/v3/users/e9ac8fcdc0ba4fe8ac9a6100ca6176a6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:51.525704 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ac8fcdc0ba4fe8ac9a6100ca6176a6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:51.528019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:51.588914 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ac8fcdc0ba4fe8ac9a6100ca6176a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.589694 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ac8fcdc0ba4fe8ac9a6100ca6176a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.598868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ac8fcdc0ba4fe8ac9a6100ca6176a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.601514 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:51.609532 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ac8fcdc0ba4fe8ac9a6100ca6176a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.627731 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ac8fcdc0ba4fe8ac9a6100ca6176a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:51.634650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1417/2799] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:35:51 2022] DELETE /identity/v3/users/e9ac8fcdc0ba4fe8ac9a6100ca6176a6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:35:51.960987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:35:51.963240 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:35:51.983481 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9abab-5e22-4b62-b5c9-e9071dfc0183 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:35:52.073548 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:35:52.074499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:35:52.074785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:35:52.075117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] PATH_INFO: `/v3/projects/bf42fdda2ec6419abb909a2732893905` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:35:52.076600 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf42fdda2ec6419abb909a2732893905)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:35:52.078671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:35:52.126880 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:52.154999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf42fdda2ec6419abb909a2732893905', 'request_id': 'req-4b4e8252-977a-4c9f-96e3-92b182d21e07'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:52.162931 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf42fdda2ec6419abb909a2732893905', 'request_id': 'req-4b4e8252-977a-4c9f-96e3-92b182d21e07'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:52.172033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf42fdda2ec6419abb909a2732893905', 'request_id': 'req-4b4e8252-977a-4c9f-96e3-92b182d21e07'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:52.195618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] The token cache is being invalidate because project bf42fdda2ec6419abb909a2732893905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:35:52.196293 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:52.197431 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b4e8252-977a-4c9f-96e3-92b182d21e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:35:52.199981 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1383/2800] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:35:51 2022] DELETE /identity/v3/projects/bf42fdda2ec6419abb909a2732893905 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:36:01.630825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:02.188645 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:16.156620 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:16.158611 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:16.174965 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4800271-79ae-4361-9188-c42c4aa57d43 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:16.245411 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:16.246379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.246664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.246944 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] PATH_INFO: `/v3/users/ea6315e57f3a434898b7df0642775227` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.248270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6315e57f3a434898b7df0642775227)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:16.250323 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:16.312340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6315e57f3a434898b7df0642775227'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:16.313669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6315e57f3a434898b7df0642775227'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:16.327796 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6315e57f3a434898b7df0642775227'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:16.340057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6315e57f3a434898b7df0642775227'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:16.361546 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6315e57f3a434898b7df0642775227'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:16.369867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1418/2801] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:36:16 2022] DELETE /identity/v3/users/ea6315e57f3a434898b7df0642775227 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:36:16.376694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.377245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.377670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.411636 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:16.414304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:16.517266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1384/2802] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:16.529151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:16.531171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:16.602412 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a294c4-3379-4573-a552-2268c9f9158e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:16.606502 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c3775-7032-4cd9-af95-a89cb004ce35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:16.607246 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c3775-7032-4cd9-af95-a89cb004ce35 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.607530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c3775-7032-4cd9-af95-a89cb004ce35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.607806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c3775-7032-4cd9-af95-a89cb004ce35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.619201 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c3775-7032-4cd9-af95-a89cb004ce35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:16.620676 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c3775-7032-4cd9-af95-a89cb004ce35 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:16.632697 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1419/2803] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:16.954897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:16.957551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:16.981414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb339924-3701-4b90-8011-2c7842d2da35 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:16.989950 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:16.991209 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.991656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.992006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] PATH_INFO: `/v3/projects/e278ba71423145b99dee86814b26e23e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.993635 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e278ba71423145b99dee86814b26e23e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:16.996289 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.068412 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e278ba71423145b99dee86814b26e23e', 'request_id': 'req-8a6aad6e-c675-4f34-b790-1337bb37747b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:17.074807 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e278ba71423145b99dee86814b26e23e', 'request_id': 'req-8a6aad6e-c675-4f34-b790-1337bb37747b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:17.082310 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e278ba71423145b99dee86814b26e23e', 'request_id': 'req-8a6aad6e-c675-4f34-b790-1337bb37747b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:17.099291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] The token cache is being invalidate because project e278ba71423145b99dee86814b26e23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:36:17.100316 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:17.101150 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8a6aad6e-c675-4f34-b790-1337bb37747b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:17.103382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1385/2804] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:36:16 2022] DELETE /identity/v3/projects/e278ba71423145b99dee86814b26e23e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:36:17.109038 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.109452 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.109840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.144823 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:17.146150 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:17.157177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:17.222746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1420/2805] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:17.231813 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.232154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.232720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.254040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:17.255191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:17.263673 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1386/2806] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:17.268215 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.278834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e730ec-6627-46a7-a9b7-7e036f913141 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.283926 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.284613 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.284900 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.285295 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.286076 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:36:17.286390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.289017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.303313 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1421/2807] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:36:17.308084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.318696 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9db2-8c2f-4378-8bd9-49e9b2e86337 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.323684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.324394 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.324679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.324956 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.325680 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.327957 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.358191 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1387/2808] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:36:17 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:36:17.362782 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.374577 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238aec0c-fb89-4239-bf25-a9603720d609 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.442684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.443497 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.443852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.444185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.444955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.447060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.472239 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1422/2809] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:36:17 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:36:17.477435 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.494052 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526847fc-4c83-4797-8816-5446aaa77c6e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.500480 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.501176 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.501462 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.501741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.502518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.505201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.522973 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1388/2810] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:36:17.527533 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.539848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1c655-a019-412c-ab6a-76e337fe6310 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.544939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6f1fa-f2ea-42f0-bcaf-9d53f9a23bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.545684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6f1fa-f2ea-42f0-bcaf-9d53f9a23bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.546057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6f1fa-f2ea-42f0-bcaf-9d53f9a23bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.546384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6f1fa-f2ea-42f0-bcaf-9d53f9a23bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.547171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6f1fa-f2ea-42f0-bcaf-9d53f9a23bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.549026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6f1fa-f2ea-42f0-bcaf-9d53f9a23bb3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.561281 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1423/2811] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:36:17.566227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.577245 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30411-1dff-4283-864f-3cbab4b38d69 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.582577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.583492 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.583770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.584547 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] PATH_INFO: `/v3/projects/258826229fa5470daaa90b02dbf9249a/users/c797a5ca1a4e49189ab2258d8e492c01/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.603562 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258826229fa5470daaa90b02dbf9249a, user_id=c797a5ca1a4e49189ab2258d8e492c01, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.608890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.626471 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1389/2812] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:36:17 2022] PUT /identity/v3/projects/258826229fa5470daaa90b02dbf9249a/users/c797a5ca1a4e49189ab2258d8e492c01/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:36:17.639557 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.640287 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.640809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.684787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] MFA Rules not processed for user `c797a5ca1a4e49189ab2258d8e492c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:17.686140 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:17.761916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1424/2813] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:17.780432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:17.783227 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:17.822900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:17.894334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d11c4e-86dd-4295-93a0-108d8d7cef08 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:17.901122 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65036b5-e043-4689-a61c-5ffa6339be33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:17.902268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65036b5-e043-4689-a61c-5ffa6339be33 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:17.902746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65036b5-e043-4689-a61c-5ffa6339be33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:17.903062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65036b5-e043-4689-a61c-5ffa6339be33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:17.919504 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65036b5-e043-4689-a61c-5ffa6339be33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:17.922410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65036b5-e043-4689-a61c-5ffa6339be33 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:17.941389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1390/2814] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:23.217652 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:23.229217 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:23.296637 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9cafe-f2f2-47ac-8f1c-5b01bde2b5ac None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:23.301360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:23.302289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.302602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.302880 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] PATH_INFO: `/v3/users/c797a5ca1a4e49189ab2258d8e492c01` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.304199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c797a5ca1a4e49189ab2258d8e492c01)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:23.306241 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:23.364420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c797a5ca1a4e49189ab2258d8e492c01'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:23.365130 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c797a5ca1a4e49189ab2258d8e492c01'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:23.373403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c797a5ca1a4e49189ab2258d8e492c01'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:23.383438 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c797a5ca1a4e49189ab2258d8e492c01'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:23.399506 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c797a5ca1a4e49189ab2258d8e492c01'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:23.406267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1425/2815] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:36:23 2022] DELETE /identity/v3/users/c797a5ca1a4e49189ab2258d8e492c01 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:36:23.412518 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.413099 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.413476 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.443130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:23.445101 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:23.533703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1391/2816] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:23.544459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:23.545928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:23.607695 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f6f2-c5bb-420f-9b67-7c69693d7071 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:23.611512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:23.612181 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.612467 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.612746 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.623082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:23.624576 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:23.635290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1426/2817] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:23.936010 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:23.937800 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:23.954914 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec285cd5-79a3-43a0-9f23-67226fb40fc4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:23.959913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:23.960814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.961158 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.961393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] PATH_INFO: `/v3/projects/258826229fa5470daaa90b02dbf9249a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.964410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=258826229fa5470daaa90b02dbf9249a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:23.968577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:24.020786 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258826229fa5470daaa90b02dbf9249a', 'request_id': 'req-eacaf432-1167-4f41-ad5e-6f063878d20f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:24.026936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258826229fa5470daaa90b02dbf9249a', 'request_id': 'req-eacaf432-1167-4f41-ad5e-6f063878d20f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:24.034385 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258826229fa5470daaa90b02dbf9249a', 'request_id': 'req-eacaf432-1167-4f41-ad5e-6f063878d20f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:24.049500 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] The token cache is being invalidate because project 258826229fa5470daaa90b02dbf9249a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:36:24.049792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:24.050488 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eacaf432-1167-4f41-ad5e-6f063878d20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:36:24.052062 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1392/2818] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:36:23 2022] DELETE /identity/v3/projects/258826229fa5470daaa90b02dbf9249a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:36:33.631717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:34.046198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:37:01.248339 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:37:01.250303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:37:01.370442 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8671-20e9-4fb1-a4ff-b81e2407c63b service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:37:01.449455 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:37:01.450170 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:37:01.450456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:37:01.450732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:37:01.452934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:37:01.466754 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:37:01.468487 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:37:01.480658 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1427/2819] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:37:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:37:11.476279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=67 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:18.094297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:18.096266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:18.096266 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:18.114838 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] MFA Rules not processed for user `406486b0d8b04508874496d7b741f619`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:18.116090 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:18.190103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1393/2820] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:18.556982 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:18.558838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:18.624600 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7928b7-119d-476e-8351-141990f21b3b service placement] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:18.629459 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:18.630389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:18.630729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:18.630985 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:18.633205 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:18.644265 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:18.645774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:18.655191 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1428/2821] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:38:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:19.033804 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:19.035938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:19.062426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aff5fd-0d53-4066-8a4e-56c6bbaa0a47 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:19.071221 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:19.072345 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:19.072847 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:19.073354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:19.076919 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:19.099990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:19.102252 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:19.116102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1394/2822] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:38:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:26.703002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:26.705177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.904815 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdf1b8-bf46-435b-9b23-d68101a5f41a service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:26.911820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:26.912493 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.912778 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.913051 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.914980 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.929580 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:26.931267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:26.946213 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1429/2823] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:38:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:29.109829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=31 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:36.940999 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=72 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:36.143890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:36.158268 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fd7b-5b09-4fc7-9dab-beb1ee869757 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:36.164057 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:36.164710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:36.164988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:36.165270 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:36.167204 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:36.179393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:36.181117 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:36.191987 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1395/2824] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:39:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:37.676475 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.678434 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:37.772123 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba956-6a19-402a-ae1b-f7d8d3797d00 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.776102 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.776770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.777059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.777337 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.779230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:37.794322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.796249 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.809482 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1430/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:39:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:41.840466 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:41.841988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:41.856857 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653daa4-f870-49e0-9217-0f81a77eb09c service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:41.860532 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:41.861194 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:41.861474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:41.861748 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:41.863727 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:41.877934 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:41.879402 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:41.891681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1396/2826] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:39:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:47.803856 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=35 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:51.885926 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=12 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:57.010104 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:57.021774 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d538-af53-4274-89ee-276471e24c77 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:57.025711 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:57.026552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:57.026935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:57.027319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:57.029375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:57.116461 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:57.118153 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:57.129942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1431/2827] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:00.914074 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:00.943433 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919daa1-d1db-4ae6-a631-a97c1749d16e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:00.954299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:00.956404 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.957154 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.958286 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.963642 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:00.999054 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.002384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.009329 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.010956 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.034357 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eb3e6-6005-43fc-8486-6bc368f2bf52 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.035226 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1397/2828] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:01.041709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.043414 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.043877 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.044345 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] PATH_INFO: `/v3/users/406486b0d8b04508874496d7b741f619` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.046636 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] RBAC: Authorizing `identity:delete_user(user_id=406486b0d8b04508874496d7b741f619)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.050371 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.111895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406486b0d8b04508874496d7b741f619'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.112760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406486b0d8b04508874496d7b741f619'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.121315 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406486b0d8b04508874496d7b741f619'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.131151 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406486b0d8b04508874496d7b741f619'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.147283 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-81af643a-a20a-477b-b587-b58b9432423e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406486b0d8b04508874496d7b741f619'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.156838 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1432/2829] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:40:01 2022] DELETE /identity/v3/users/406486b0d8b04508874496d7b741f619 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:01.407183 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.419056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329371a-152e-418c-94da-9a42dcf68784 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.494130 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.495451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.495651 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.495865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] PATH_INFO: `/v3/projects/4ef1cbec0c354158ba9b1b0d85634702` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.497257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef1cbec0c354158ba9b1b0d85634702)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.499659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.559437 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef1cbec0c354158ba9b1b0d85634702', 'request_id': 'req-5f9c78d0-e237-4341-a254-da66710c2492'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.566413 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef1cbec0c354158ba9b1b0d85634702', 'request_id': 'req-5f9c78d0-e237-4341-a254-da66710c2492'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.573909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef1cbec0c354158ba9b1b0d85634702', 'request_id': 'req-5f9c78d0-e237-4341-a254-da66710c2492'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.590829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] The token cache is being invalidate because project 4ef1cbec0c354158ba9b1b0d85634702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:01.591115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.591802 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f9c78d0-e237-4341-a254-da66710c2492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.593442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1398/2830] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:40:01 2022] DELETE /identity/v3/projects/4ef1cbec0c354158ba9b1b0d85634702 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:01.598948 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.599430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.599817 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.620027 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:01.622776 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.695500 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1433/2831] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:01.718909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.718909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.718909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.741783 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:01.743079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.752213 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1399/2832] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:01.757070 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.768144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8b144-db54-4c12-bb61-b35aaf142a71 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.773078 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.773769 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.774081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.774379 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.775179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:01.775486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.777188 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.779331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:01.797821 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1434/2833] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:40:01.803920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.815249 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824dc89-94b2-4276-a3b0-750bfded7ab0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.820184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.820862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.821142 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.821414 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.822162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.824092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.856970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1400/2834] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:01.862920 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.874018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0528ba-21fd-4bf1-90eb-ee81fbd5684f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.979881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.980584 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.980867 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.981143 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.981844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.984033 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.010638 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1435/2835] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:02.015178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.034393 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78086-e452-4669-b153-e7f691736824 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.041139 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.041921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.042299 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.042606 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.043440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.046001 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.059758 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1401/2836] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:02.064810 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.075721 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dc38c-ce7d-4f97-927f-fbce04c016df admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.081178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cab500-3e26-43a5-a572-54d4436bd850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.081952 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cab500-3e26-43a5-a572-54d4436bd850 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.082450 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cab500-3e26-43a5-a572-54d4436bd850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.082804 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cab500-3e26-43a5-a572-54d4436bd850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.083748 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cab500-3e26-43a5-a572-54d4436bd850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.085643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cab500-3e26-43a5-a572-54d4436bd850 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.098866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1436/2837] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:02.105095 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.116974 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349014a-5985-4a50-ba01-aeb565a3604f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.122499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.123399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.123677 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.123944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] PATH_INFO: `/v3/projects/d750c29941534fdfb5e860fdfe2f7241/users/61710329892448e2834bb957c30466be/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.142544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d750c29941534fdfb5e860fdfe2f7241, user_id=61710329892448e2834bb957c30466be, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.145322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.163358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1402/2838] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:02 2022] PUT /identity/v3/projects/d750c29941534fdfb5e860fdfe2f7241/users/61710329892448e2834bb957c30466be/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:02.175332 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.175687 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.176002 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.209117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] MFA Rules not processed for user `61710329892448e2834bb957c30466be`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:02.210471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.288508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1437/2839] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:02.302475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.304214 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.321545 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:02.376683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93c125-d3dd-462a-a1a4-518f915fe150 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.380399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f4673-4382-4d20-9953-ed984e216c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.381109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4673-4382-4d20-9953-ed984e216c60 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.381427 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4673-4382-4d20-9953-ed984e216c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.381740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4673-4382-4d20-9953-ed984e216c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.392138 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f4673-4382-4d20-9953-ed984e216c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.393694 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f4673-4382-4d20-9953-ed984e216c60 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.407713 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1403/2840] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:11.409767 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.485645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5404-c6cd-4c50-aa27-0335b9fc9d3c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.490574 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.491479 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.491760 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.492035 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] PATH_INFO: `/v3/users/61710329892448e2834bb957c30466be` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.493342 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61710329892448e2834bb957c30466be)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:11.495362 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:11.498525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:11.556014 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61710329892448e2834bb957c30466be'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.556763 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61710329892448e2834bb957c30466be'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.565816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61710329892448e2834bb957c30466be'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.575290 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61710329892448e2834bb957c30466be'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.589813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61710329892448e2834bb957c30466be'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.596606 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1438/2841] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:40:11 2022] DELETE /identity/v3/users/61710329892448e2834bb957c30466be => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:11.602605 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.603201 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.603593 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.627572 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:11.629722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:11.705395 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1404/2842] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:11.716747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.719093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:11.795420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d169-73aa-49e8-b363-e02946bacb90 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.799871 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9aa91-6b49-4ccb-9f68-ed3561f9cdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.800555 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9aa91-6b49-4ccb-9f68-ed3561f9cdff service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.800840 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9aa91-6b49-4ccb-9f68-ed3561f9cdff service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.801120 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9aa91-6b49-4ccb-9f68-ed3561f9cdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.811868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9aa91-6b49-4ccb-9f68-ed3561f9cdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:11.813530 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9aa91-6b49-4ccb-9f68-ed3561f9cdff service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:11.824854 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1439/2843] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:12.208773 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.210451 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.225705 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677b28e-1fa5-4444-b0db-9353c77cdd53 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.234618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.236160 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.236668 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.237163 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] PATH_INFO: `/v3/projects/d750c29941534fdfb5e860fdfe2f7241` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.239506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d750c29941534fdfb5e860fdfe2f7241)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.243338 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.305891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd750c29941534fdfb5e860fdfe2f7241', 'request_id': 'req-8b4d5c08-40b2-4322-a1a4-4d32601baec3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.312701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd750c29941534fdfb5e860fdfe2f7241', 'request_id': 'req-8b4d5c08-40b2-4322-a1a4-4d32601baec3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.319604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd750c29941534fdfb5e860fdfe2f7241', 'request_id': 'req-8b4d5c08-40b2-4322-a1a4-4d32601baec3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.336215 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] The token cache is being invalidate because project d750c29941534fdfb5e860fdfe2f7241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:12.336589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.337472 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b4d5c08-40b2-4322-a1a4-4d32601baec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.339332 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1405/2844] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:40:12 2022] DELETE /identity/v3/projects/d750c29941534fdfb5e860fdfe2f7241 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:12.345558 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.345896 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.346274 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.365602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:12.366973 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.445440 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1440/2845] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:12.455344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.455747 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.456192 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.477711 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:12.479207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.488210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1406/2846] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:12.493382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.505583 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56643764-5dea-47ad-93f9-22178cd4e164 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.510732 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.511420 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.511698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.511972 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.512716 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:12.513021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.514759 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.528846 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1441/2847] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:40:12.534389 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.544656 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681bc91-55e5-4a7f-9765-40c807baa347 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.549939 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.550670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.550953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.551229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.551944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.553906 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.586533 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1407/2848] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:12.589269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.608166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9c65a-8478-4226-9b2f-7944a39f396a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.622912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:12.685301 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.686185 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.686516 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.686834 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.688175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.690305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.714669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1442/2849] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:12.719262 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.730865 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0dea-3df0-43d6-9bfc-26d85bbd3f71 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.735858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.736531 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.736814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.737088 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.737819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.739537 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.745954 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:12.756975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1408/2850] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:12.758869 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.769934 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39184f-2cee-49cc-9dea-bda0bf58a72d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.774878 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ad6f2-248c-4d58-9f17-78c650c9619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.775562 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ad6f2-248c-4d58-9f17-78c650c9619e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.775848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ad6f2-248c-4d58-9f17-78c650c9619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.776125 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ad6f2-248c-4d58-9f17-78c650c9619e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.776852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ad6f2-248c-4d58-9f17-78c650c9619e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.778524 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ad6f2-248c-4d58-9f17-78c650c9619e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.789699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1443/2851] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:12.795988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.807094 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4479f7-2cd2-443b-9cb4-23a16b513ae7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.812693 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.813610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.813891 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.814198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] PATH_INFO: `/v3/projects/e15f5ff0a2c345ca89095af03f118170/users/79d5af91795e492b96c9b1b2e28e8e06/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.832628 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15f5ff0a2c345ca89095af03f118170, user_id=79d5af91795e492b96c9b1b2e28e8e06, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.835475 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.862514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1409/2852] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:12 2022] PUT /identity/v3/projects/e15f5ff0a2c345ca89095af03f118170/users/79d5af91795e492b96c9b1b2e28e8e06/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:12.885326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.885664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.886813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.922169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] MFA Rules not processed for user `79d5af91795e492b96c9b1b2e28e8e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:12.923445 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:13.006879 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1444/2853] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:13.011835 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.088033 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbef11-a323-4597-b245-eb94235ac16a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.094302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.095302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.095959 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.097675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.100098 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.103808 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.133581 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1410/2854] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:40:13 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:13.138207 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.150224 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c204c-66b5-4037-b881-08408a09353b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.219133 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.219938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.220397 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.220744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.221664 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.224165 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.249843 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1445/2855] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:40:13 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:13.255229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.274799 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c160ea0-d98a-46c6-bb9b-7488da8cad89 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.283340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.284638 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.285131 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.285632 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.287084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.290280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.312935 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1411/2856] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:13.318187 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.332889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f605f6-42ee-4ca2-a889-2dc7dd22f92b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.340997 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.342552 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.343028 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.343525 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] PATH_INFO: `/v3/projects/2b3c6430a8ca41ab8165a415260b3d99/users/ec81b1ed84ef44228f1b051cd986cd40/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.349393 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:13.376560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3c6430a8ca41ab8165a415260b3d99, user_id=ec81b1ed84ef44228f1b051cd986cd40, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.381885 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.400656 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1446/2857] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:13 2022] PUT /identity/v3/projects/2b3c6430a8ca41ab8165a415260b3d99/users/ec81b1ed84ef44228f1b051cd986cd40/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:13.406432 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.417145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225053-4b45-445a-9fbe-4393e510a44c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.483325 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0428493-607d-4931-8bba-d9c1d4fa70b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.484702 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0428493-607d-4931-8bba-d9c1d4fa70b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.484984 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0428493-607d-4931-8bba-d9c1d4fa70b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.485257 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0428493-607d-4931-8bba-d9c1d4fa70b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.486093 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0428493-607d-4931-8bba-d9c1d4fa70b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.487750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0428493-607d-4931-8bba-d9c1d4fa70b9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.504637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1412/2858] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:13.510556 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.526080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf125c-1c31-408d-9695-66f15b63ca98 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.531582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.532504 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.532789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.533059 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] PATH_INFO: `/v3/projects/2b3c6430a8ca41ab8165a415260b3d99/users/ec81b1ed84ef44228f1b051cd986cd40/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.535237 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3c6430a8ca41ab8165a415260b3d99, user_id=ec81b1ed84ef44228f1b051cd986cd40, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.537941 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.550684 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1447/2859] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:13 2022] PUT /identity/v3/projects/2b3c6430a8ca41ab8165a415260b3d99/users/ec81b1ed84ef44228f1b051cd986cd40/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:13.561410 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f814-1124-4733-94f4-841469c12263 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.561703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f814-1124-4733-94f4-841469c12263 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.562046 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f814-1124-4733-94f4-841469c12263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.594021 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-aa63f814-1124-4733-94f4-841469c12263 None None] MFA Rules not processed for user `ec81b1ed84ef44228f1b051cd986cd40`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:13.595317 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aa63f814-1124-4733-94f4-841469c12263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:13.638271 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:13.681503 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1413/2860] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:13.693474 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:13.695280 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:13.768389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87796-d5fc-4d07-9982-66d35f841840 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.773894 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.775091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.775582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.776071 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.873322 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.874743 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.887291 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1448/2861] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:15.363561 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f814-1124-4733-94f4-841469c12263 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:15.365346 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aa63f814-1124-4733-94f4-841469c12263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:15.379272 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f814-1124-4733-94f4-841469c12263 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:15.383349 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f60ef-ef22-4f8d-8a36-9d3d60c647a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:15.384207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f60ef-ef22-4f8d-8a36-9d3d60c647a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:15.384554 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f60ef-ef22-4f8d-8a36-9d3d60c647a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:15.384952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f60ef-ef22-4f8d-8a36-9d3d60c647a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:15.395700 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f60ef-ef22-4f8d-8a36-9d3d60c647a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:15.397179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f60ef-ef22-4f8d-8a36-9d3d60c647a0 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:15.408923 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1414/2862] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:19.328498 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:19.408284 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fac76-5f19-4f8a-bfbf-99db805fc50c service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:19.413805 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:19.415053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:19.415373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:19.415713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] PATH_INFO: `/v3/users/79d5af91795e492b96c9b1b2e28e8e06` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:19.417234 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d5af91795e492b96c9b1b2e28e8e06)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:19.419275 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:19.456568 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:19.482729 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d5af91795e492b96c9b1b2e28e8e06'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:19.484346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d5af91795e492b96c9b1b2e28e8e06'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:19.494331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d5af91795e492b96c9b1b2e28e8e06'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:19.511269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d5af91795e492b96c9b1b2e28e8e06'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:19.528343 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d5af91795e492b96c9b1b2e28e8e06'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:19.537053 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1449/2863] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:40:19 2022] DELETE /identity/v3/users/79d5af91795e492b96c9b1b2e28e8e06 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:19.543683 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:19.544337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:19.544337 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:19.564359 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:19.565650 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:19.661169 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1415/2864] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:19.680252 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:19.681725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:19.749950 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7834c-4753-4c60-9480-47cce4745af4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:19.754699 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:19.755472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:19.755800 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:19.756231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:19.768469 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:19.769866 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:19.781463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1450/2865] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:20.108314 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:20.110196 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:20.127970 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078ed7-9053-4977-acd7-1401b72e30a0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:20.136604 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:20.138202 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:20.138701 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:20.140448 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] PATH_INFO: `/v3/projects/e15f5ff0a2c345ca89095af03f118170` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:20.142937 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15f5ff0a2c345ca89095af03f118170)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:20.145274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:20.204837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15f5ff0a2c345ca89095af03f118170', 'request_id': 'req-ed29f318-6539-413d-9f7f-e80f16274cba'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.211485 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15f5ff0a2c345ca89095af03f118170', 'request_id': 'req-ed29f318-6539-413d-9f7f-e80f16274cba'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.218722 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15f5ff0a2c345ca89095af03f118170', 'request_id': 'req-ed29f318-6539-413d-9f7f-e80f16274cba'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.235182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] The token cache is being invalidate because project e15f5ff0a2c345ca89095af03f118170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:20.235494 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.236165 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.237779 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1416/2866] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:40:20 2022] DELETE /identity/v3/projects/e15f5ff0a2c345ca89095af03f118170 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:20.242430 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:20.254109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fbdc-bb75-4676-b373-1c785d1d30ed service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:20.322141 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:20.322939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:20.323270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:20.323542 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] PATH_INFO: `/v3/users/ec81b1ed84ef44228f1b051cd986cd40` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:20.324818 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec81b1ed84ef44228f1b051cd986cd40)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:20.327075 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:20.384049 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec81b1ed84ef44228f1b051cd986cd40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.384868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec81b1ed84ef44228f1b051cd986cd40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.387211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:20.396667 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec81b1ed84ef44228f1b051cd986cd40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.411921 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec81b1ed84ef44228f1b051cd986cd40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.434855 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1114d657-a8e0-4e33-bf53-8c1ca0fe29ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec81b1ed84ef44228f1b051cd986cd40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:20.446447 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1451/2867] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:40:20 2022] DELETE /identity/v3/users/ec81b1ed84ef44228f1b051cd986cd40 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:20.801750 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:20.803819 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:20.826048 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f318-6539-413d-9f7f-e80f16274cba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:20.881336 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:20.913887 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:20.915483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:20.915979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:20.916490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] PATH_INFO: `/v3/projects/2b3c6430a8ca41ab8165a415260b3d99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:20.918746 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3c6430a8ca41ab8165a415260b3d99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:20.923586 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:20.998396 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3c6430a8ca41ab8165a415260b3d99', 'request_id': 'req-2f37b5fa-354b-43a9-af34-031a3c97daf4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.009789 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3c6430a8ca41ab8165a415260b3d99', 'request_id': 'req-2f37b5fa-354b-43a9-af34-031a3c97daf4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.022839 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3c6430a8ca41ab8165a415260b3d99', 'request_id': 'req-2f37b5fa-354b-43a9-af34-031a3c97daf4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.043076 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] The token cache is being invalidate because project 2b3c6430a8ca41ab8165a415260b3d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:21.043514 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.044297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2f37b5fa-354b-43a9-af34-031a3c97daf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.046188 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1417/2868] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:40:20 2022] DELETE /identity/v3/projects/2b3c6430a8ca41ab8165a415260b3d99 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:21.051610 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.051881 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.052155 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.072304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:21.073539 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.176571 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1452/2869] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:21.186539 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.187109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.187589 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.220936 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:21.223116 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.238084 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1418/2870] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:21.242463 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.253243 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a43da3-ffb7-48a7-9ea2-aafcd6cdc84e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.258935 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.259820 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.260131 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.260407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.261303 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:21.261472 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.263279 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.278630 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1453/2871] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:40:21.283920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.294162 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969865c-4b2f-4575-94ff-2bb0fc31997c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.299877 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.300595 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.300873 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.301143 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.301888 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.303993 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.338068 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1419/2872] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:21.342195 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.353268 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cac264-6c30-407e-9b85-242090d27a80 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.425216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.426403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.426403 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.426794 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.427168 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.429175 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.453661 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1454/2873] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:21.458184 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.471114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd2301-b2b4-4cb8-95b3-94a6dcbc6ad6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.476681 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.477370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.477655 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.477922 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.478710 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.480390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.496626 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1420/2874] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:21.501585 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.512669 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7be756-23d4-41ea-9c1d-10033cfe4bb6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.518717 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfc19e-2d9d-413f-89ea-228db668aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.519473 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc19e-2d9d-413f-89ea-228db668aab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.519784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc19e-2d9d-413f-89ea-228db668aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.520179 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfc19e-2d9d-413f-89ea-228db668aab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.520987 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfc19e-2d9d-413f-89ea-228db668aab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.523270 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfc19e-2d9d-413f-89ea-228db668aab1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.536710 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1455/2875] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:21.542274 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.559210 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3024e3-ed89-4626-b57b-627bcbdfbccd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.566178 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.567182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.567465 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.567740 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] PATH_INFO: `/v3/projects/082e6c65a4ed45799e0faaf43f12258e/users/527995378f1f476783c060df188fc640/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.586754 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082e6c65a4ed45799e0faaf43f12258e, user_id=527995378f1f476783c060df188fc640, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.589496 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.605749 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1421/2876] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:21 2022] PUT /identity/v3/projects/082e6c65a4ed45799e0faaf43f12258e/users/527995378f1f476783c060df188fc640/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:21.613231 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aae18-f137-4fa7-a968-0683937d700f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.613508 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aae18-f137-4fa7-a968-0683937d700f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.613787 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aae18-f137-4fa7-a968-0683937d700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.634930 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0f3aae18-f137-4fa7-a968-0683937d700f None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:21.636257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0f3aae18-f137-4fa7-a968-0683937d700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.677340 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:21.728645 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1456/2877] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:21.739843 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.742018 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.815179 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54276-d95b-4c29-835c-cdbabd1894c5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.820351 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.821086 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.821483 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.821837 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.833499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.835028 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.846019 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1422/2878] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:22.720520 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:22.721101 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:22.721324 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:22.760382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] MFA Rules not processed for user `527995378f1f476783c060df188fc640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:22.762501 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:22.869868 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1457/2879] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:22.875012 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:22.893890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cc283-cb7d-4631-81c4-ddee55631f38 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:22.903114 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:22.904297 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:22.904810 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:22.905294 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:22.906688 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:22.911120 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:22.923759 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:22.948358 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1423/2880] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:40:22 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:22.955199 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:22.969310 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a36d6-6e38-41b6-932f-3f94061edf07 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.055752 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.056895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.057370 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.057863 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.059178 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.063057 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.092798 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1458/2881] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:40:22 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:23.097564 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.109303 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe393b-80e3-4ce9-af88-b21919a3d5b6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.114944 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.115726 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.116096 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.116430 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.117291 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.119629 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.132367 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1424/2882] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:23.136928 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.148902 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a307da-26ea-4e67-95a3-4bac3862c2fe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.154163 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.155069 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.155352 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.156169 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] PATH_INFO: `/v3/projects/e36ef81672d545028ee4de7f4b262bd4/users/d202e48cb3354371b0ea778def6ea122/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.175599 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36ef81672d545028ee4de7f4b262bd4, user_id=d202e48cb3354371b0ea778def6ea122, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.178528 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.196426 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1459/2883] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:23 2022] PUT /identity/v3/projects/e36ef81672d545028ee4de7f4b262bd4/users/d202e48cb3354371b0ea778def6ea122/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:23.200801 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.213770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78eb3b-1c4d-4c3e-9c14-4aa1bf1b17b0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.280148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e57a2-6c6b-4a52-84b6-6e0550b0651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.280858 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e57a2-6c6b-4a52-84b6-6e0550b0651a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.281140 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e57a2-6c6b-4a52-84b6-6e0550b0651a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.281415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e57a2-6c6b-4a52-84b6-6e0550b0651a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.282182 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e57a2-6c6b-4a52-84b6-6e0550b0651a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.283845 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e57a2-6c6b-4a52-84b6-6e0550b0651a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.294862 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1425/2884] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:23.299601 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.311328 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01859ac7-0721-498a-a5a2-94a76b4d198d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.316969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c8061-7f21-4cf8-afa4-12095747b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.317994 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8061-7f21-4cf8-afa4-12095747b716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.318319 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8061-7f21-4cf8-afa4-12095747b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.318665 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8061-7f21-4cf8-afa4-12095747b716 admin admin] PATH_INFO: `/v3/projects/e36ef81672d545028ee4de7f4b262bd4/users/d202e48cb3354371b0ea778def6ea122/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.320970 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c8061-7f21-4cf8-afa4-12095747b716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36ef81672d545028ee4de7f4b262bd4, user_id=d202e48cb3354371b0ea778def6ea122, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.323974 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c8061-7f21-4cf8-afa4-12095747b716 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.336744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1460/2885] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:40:23 2022] PUT /identity/v3/projects/e36ef81672d545028ee4de7f4b262bd4/users/d202e48cb3354371b0ea778def6ea122/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:24.121910 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:24.122890 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:24.123102 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:24.162285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] MFA Rules not processed for user `d202e48cb3354371b0ea778def6ea122`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:24.163720 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:24.254322 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1426/2886] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:24.265635 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:24.266496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:24.266496 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:24.287092 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] MFA Rules not processed for user `527995378f1f476783c060df188fc640`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:24.288344 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:24.299682 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:24.355789 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1461/2887] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:24.367959 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:24.369461 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:24.431928 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:24.459658 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cea90-ae5a-4dcc-a96c-234aab677598 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:24.465369 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:24.466072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:24.466360 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:24.466689 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:24.476161 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:24.477792 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:24.488781 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1427/2888] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:27.041082 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:27.042942 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:27.107561 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee346574-2efd-4c52-9bc0-f31cc5ea6516 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:27.114470 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:27.115116 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:27.115443 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:27.115756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:27.117939 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:27.130258 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:27.132017 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:27.141651 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1462/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:27.933659 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:27.947699 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85d001-1e78-41e5-a333-5beb1553c98e service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:27.957407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9799f9d11546403e8b46ad386be470d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:27.958344 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:27.959583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:27.959583 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:27.961979 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:27.980951 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:27.984125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:27.998999 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1428/2890] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:37.137349 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=44 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:37.991882 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=13 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:40.257109 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:40.259331 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:40.366338 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6044660-2c5b-4ce0-9e9f-6ca38f67dd7c service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:40.370144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:40.370809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:40.371093 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:40.371372 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:40.381744 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:40.383300 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:40.394857 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1463/2891] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:40:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:50.389415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=26 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:00.432125 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:00.433735 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:00.556932 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be147ca-9ac8-47fd-9160-853b761d6829 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:00.566315 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:00.567644 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:00.568115 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:00.568603 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:00.571618 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:00.593637 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:00.596570 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:00.616964 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1429/2892] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:01.353058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:01.434992 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fb32d-5687-4c62-980f-f19452e4419a service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:01.440299 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:01.441192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:01.441478 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:01.441756 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] PATH_INFO: `/v3/users/527995378f1f476783c060df188fc640` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:01.443407 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527995378f1f476783c060df188fc640)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:01.445390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:01.501081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527995378f1f476783c060df188fc640'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.502725 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527995378f1f476783c060df188fc640'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.519911 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527995378f1f476783c060df188fc640'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.534298 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527995378f1f476783c060df188fc640'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.548118 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527995378f1f476783c060df188fc640'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.554663 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1464/2893] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:41:01 2022] DELETE /identity/v3/users/527995378f1f476783c060df188fc640 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:01.792053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:01.806823 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c210-c14b-450c-9847-a17dcece2862 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:01.899455 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:01.900384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:01.900671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:01.901092 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] PATH_INFO: `/v3/projects/082e6c65a4ed45799e0faaf43f12258e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:01.902611 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082e6c65a4ed45799e0faaf43f12258e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:01.904817 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:01.959989 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082e6c65a4ed45799e0faaf43f12258e', 'request_id': 'req-c246279b-aacc-4985-a7d4-c1bb396b9070'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.971995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082e6c65a4ed45799e0faaf43f12258e', 'request_id': 'req-c246279b-aacc-4985-a7d4-c1bb396b9070'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:01.981508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082e6c65a4ed45799e0faaf43f12258e', 'request_id': 'req-c246279b-aacc-4985-a7d4-c1bb396b9070'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.001737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] The token cache is being invalidate because project 082e6c65a4ed45799e0faaf43f12258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:02.002280 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.003334 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.005218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1430/2894] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:41:01 2022] DELETE /identity/v3/projects/082e6c65a4ed45799e0faaf43f12258e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:41:02.009726 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:02.011491 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:02.036147 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a702-1c65-41b5-8e36-ae53431cc428 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:02.135235 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:02.136316 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:02.136602 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:02.136889 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] PATH_INFO: `/v3/users/d202e48cb3354371b0ea778def6ea122` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:02.138257 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d202e48cb3354371b0ea778def6ea122)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:02.140304 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:02.169844 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:02.206004 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd202e48cb3354371b0ea778def6ea122'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.206784 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd202e48cb3354371b0ea778def6ea122'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.215905 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd202e48cb3354371b0ea778def6ea122'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.226064 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd202e48cb3354371b0ea778def6ea122'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.244955 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4a1c52ff-22bb-43dd-9937-093f48a7a879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd202e48cb3354371b0ea778def6ea122'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.252996 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1465/2895] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:41:02 2022] DELETE /identity/v3/users/d202e48cb3354371b0ea778def6ea122 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:41:02.474507 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:02.476073 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:02.493426 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246279b-aacc-4985-a7d4-c1bb396b9070 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:02.527304 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:02.580762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:02.581640 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:02.581920 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:02.582229 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] PATH_INFO: `/v3/projects/e36ef81672d545028ee4de7f4b262bd4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:02.583508 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36ef81672d545028ee4de7f4b262bd4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:02.590324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:02.645913 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36ef81672d545028ee4de7f4b262bd4', 'request_id': 'req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.656401 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36ef81672d545028ee4de7f4b262bd4', 'request_id': 'req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.672909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36ef81672d545028ee4de7f4b262bd4', 'request_id': 'req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.690499 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] The token cache is being invalidate because project e36ef81672d545028ee4de7f4b262bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:02.690785 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.691487 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1456f5e2-1c10-4fe1-8796-cbd8af63cf1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:02.693151 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1431/2896] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:41:02 2022] DELETE /identity/v3/projects/e36ef81672d545028ee4de7f4b262bd4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:02.700423 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:02.701575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:02.701575 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:02.726560 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:02.727724 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:02.812477 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1466/2897] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:41:02.820757 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:02.821380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:02.821380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:02.842544 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:02.844146 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:02.853172 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1432/2898] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:02.858197 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:02.871429 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c6de-18f2-4ac7-8ddb-75f7c85e0bc0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:02.878211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:02.878211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:02.878211 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:02.878825 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:02.879080 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:41:02.879389 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:02.881045 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:02.894747 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1467/2899] 10.222.0.61 () {58 vars in 1152 bytes} [Fri May 27 03:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:41:02.900997 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:02.911986 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b481a7-0baf-48b3-8722-061345662527 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:02.917075 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:02.917797 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:02.918123 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:02.918399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:02.919121 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:02.921770 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:02.970577 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1433/2900] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:41:02 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:41:02.971872 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:02.984612 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709db11-a4fe-430f-8322-012c5104fb56 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.055700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.056391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.056691 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.056969 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.057678 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.059702 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.083190 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1468/2901] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:41:02 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:41:03.088203 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.100703 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a23bb-d3da-4914-990b-57866a3b89dc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.106363 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.107237 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.108042 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.108324 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.109211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.111180 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.122457 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1434/2902] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:03.128174 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.139788 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3afd9a-f1f2-4e86-a6c1-8df5b40fa052 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.145267 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc9a10-17a7-4a0a-a441-640ae5c531eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.146087 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc9a10-17a7-4a0a-a441-640ae5c531eb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.146375 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc9a10-17a7-4a0a-a441-640ae5c531eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.146650 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc9a10-17a7-4a0a-a441-640ae5c531eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.147380 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc9a10-17a7-4a0a-a441-640ae5c531eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.149040 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc9a10-17a7-4a0a-a441-640ae5c531eb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.161177 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1469/2903] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:03.167319 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.178990 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299aeef-c6d6-4a6e-809b-69144a14d5ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.184060 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.184972 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.185254 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.186079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] PATH_INFO: `/v3/projects/78a27dfd812549fe9b114fe82ff3477c/users/801eafa59f7f47d08dcf75e37284367a/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.205763 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a27dfd812549fe9b114fe82ff3477c, user_id=801eafa59f7f47d08dcf75e37284367a, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.209743 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.225938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1435/2904] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:41:03 2022] PUT /identity/v3/projects/78a27dfd812549fe9b114fe82ff3477c/users/801eafa59f7f47d08dcf75e37284367a/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:03.246238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.249384 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.249870 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.267624 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:03.303415 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] MFA Rules not processed for user `801eafa59f7f47d08dcf75e37284367a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:03.304850 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:03.384859 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1470/2905] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:41:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:41:03.390056 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.439340 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:03.478780 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678a2b-0bdb-4947-b42c-6356fed7fef4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.486921 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.488072 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.488982 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.489525 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.490900 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.495144 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.545707 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1436/2906] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:41:03 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:03.550108 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.563806 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb07085-cec8-45f1-abad-1c5012143bb2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.649081 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.650390 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.650883 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.651360 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.652749 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.657039 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.686471 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1471/2907] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:41:03 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:03.691181 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.702814 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ec35f-3ab6-4ee2-82a1-67419bd56e6e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.707698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.708450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.708733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.709007 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.709733 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.711392 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.725145 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1437/2908] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:41:03.731253 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.743378 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e814-360e-4575-a9bc-0f126cd4c4c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.748916 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c975-9973-4e37-bdf9-29291d57e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.749609 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c975-9973-4e37-bdf9-29291d57e42f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.749895 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c975-9973-4e37-bdf9-29291d57e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.750643 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c975-9973-4e37-bdf9-29291d57e42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.751391 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c975-9973-4e37-bdf9-29291d57e42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.753052 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c975-9973-4e37-bdf9-29291d57e42f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.764842 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1472/2909] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:03.771929 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:03.787551 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a799a-7fe9-4a62-aea7-2ce3213ba0ca admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:03.792449 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:03.793354 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.793663 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.793938 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] PATH_INFO: `/v3/projects/51c4120ba3314c1a91ededf9b619bea7/users/0f9e428787d646838feb43a0566a0855/roles/ee525f9120064af5a37358b119bbedae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.811684 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c4120ba3314c1a91ededf9b619bea7, user_id=0f9e428787d646838feb43a0566a0855, role_id=ee525f9120064af5a37358b119bbedae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:03.814745 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:03.830908 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1438/2910] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:41:03 2022] PUT /identity/v3/projects/51c4120ba3314c1a91ededf9b619bea7/users/0f9e428787d646838feb43a0566a0855/roles/ee525f9120064af5a37358b119bbedae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:03.843912 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:03.844230 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:03.844512 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:03.888713 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] MFA Rules not processed for user `0f9e428787d646838feb43a0566a0855`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:03.890918 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:03.992569 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1473/2911] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:03.997670 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.067040 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096780-c56e-4831-9ed7-db2e6418d03c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.072137 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.072821 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.073103 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.073380 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.074135 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.076610 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.108207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1439/2912] 10.222.0.61 () {60 vars in 1152 bytes} [Fri May 27 03:41:03 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:04.114346 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.121144 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:04.133418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab288c58-a0f0-43f2-a12a-c4a6dde3e359 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.204176 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.204967 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.205296 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.205741 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.206809 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.208923 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.232653 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1474/2913] 10.222.0.61 () {60 vars in 1143 bytes} [Fri May 27 03:41:04 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:04.237911 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.250417 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671162fb-3438-4def-99af-c7bdc23bd6ba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.255598 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.256439 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.256820 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.257207 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.258166 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.260051 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.273947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1440/2914] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:04.278505 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.289689 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8dd3a-663f-411b-b66d-cd42b2b006f9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.295382 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.296377 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.296700 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.297021 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] PATH_INFO: `/v3/projects/e10801294c43480fb49b368b855a43ed/users/92b94e20ccae456e99a5c25828e6f849/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.315398 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10801294c43480fb49b368b855a43ed, user_id=92b94e20ccae456e99a5c25828e6f849, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.318386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.334814 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1475/2915] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:41:04 2022] PUT /identity/v3/projects/e10801294c43480fb49b368b855a43ed/users/92b94e20ccae456e99a5c25828e6f849/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:04.339302 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.350219 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44bfa2-69e2-4cb1-9645-2b31f0db170c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.417224 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b194-3fe1-43eb-9426-733d9f131806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.417902 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b194-3fe1-43eb-9426-733d9f131806 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.418218 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b194-3fe1-43eb-9426-733d9f131806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.418490 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b194-3fe1-43eb-9426-733d9f131806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.419285 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0b194-3fe1-43eb-9426-733d9f131806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.421442 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0b194-3fe1-43eb-9426-733d9f131806 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.424198 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:04.437675 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1441/2916] 10.222.0.61 () {58 vars in 1121 bytes} [Fri May 27 03:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:04.439058 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.450435 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ff351-4301-4258-8a8c-1c70456cf175 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.455709 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.456696 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.457026 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.457424 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] PATH_INFO: `/v3/projects/e10801294c43480fb49b368b855a43ed/users/92b94e20ccae456e99a5c25828e6f849/roles/d0122fde930842079d42ce76139767e2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.459671 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10801294c43480fb49b368b855a43ed, user_id=92b94e20ccae456e99a5c25828e6f849, role_id=d0122fde930842079d42ce76139767e2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.462553 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.475582 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1476/2917] 10.222.0.61 () {60 vars in 1482 bytes} [Fri May 27 03:41:04 2022] PUT /identity/v3/projects/e10801294c43480fb49b368b855a43ed/users/92b94e20ccae456e99a5c25828e6f849/roles/d0122fde930842079d42ce76139767e2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:04.486909 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.487235 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.487440 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.519737 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] MFA Rules not processed for user `92b94e20ccae456e99a5c25828e6f849`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:04.521006 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:04.600434 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1442/2918] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:41:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:04.613456 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.616216 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:04.725220 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d084c33-e375-4b26-bc16-d9bb2080de30 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.731639 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.733289 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.733771 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.734326 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.807677 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.809277 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.822062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1477/2919] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:41:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:41:06.441200 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:06.443079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:06.455988 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de6f9-a726-46b7-b23b-3c6634dbfb87 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:06.459752 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:06.460415 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:06.460698 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:06.460975 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:06.530474 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:06.531953 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:06.542947 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1443/2920] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:41:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:41:07.197100 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:07.212206 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bac85-488c-43f4-b9a9-4712c31c8f1d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:07.217938 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f80a33-4662-4932-920d-8f1ba91a58cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8bc75da330c48aab2b15609eb495cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:07.219019 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f80a33-4662-4932-920d-8f1ba91a58cd service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:07.219486 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f80a33-4662-4932-920d-8f1ba91a58cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:07.219957 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f80a33-4662-4932-920d-8f1ba91a58cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:07.233705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:07.237321 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f80a33-4662-4932-920d-8f1ba91a58cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:07.239607 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f80a33-4662-4932-920d-8f1ba91a58cd service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:07.253091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1478/2921] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:41:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:11.383000 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:11.455829 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2caa5e-ebcc-4a18-a15b-f29df22c2e7b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:11.460506 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:11.461399 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:11.461679 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:11.461955 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] PATH_INFO: `/v3/users/801eafa59f7f47d08dcf75e37284367a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:11.463211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801eafa59f7f47d08dcf75e37284367a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:11.465225 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:11.492573 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:11.530211 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801eafa59f7f47d08dcf75e37284367a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:11.546113 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801eafa59f7f47d08dcf75e37284367a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:11.555281 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801eafa59f7f47d08dcf75e37284367a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:11.555980 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801eafa59f7f47d08dcf75e37284367a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:11.565467 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801eafa59f7f47d08dcf75e37284367a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:11.572450 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1444/2922] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:41:11 2022] DELETE /identity/v3/users/801eafa59f7f47d08dcf75e37284367a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:11.578269 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:11.578901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:11.578901 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:11.600273 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] MFA Rules not processed for user `a29912cd78134fb2b757b551f0545235`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:11.602171 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:11.672705 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1479/2923] 10.222.0.61 () {58 vars in 957 bytes} [Fri May 27 03:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:11.683365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:11.685664 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:11.759026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698649f6-10f9-41db-bd0d-6e5cefdd24f2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:11.763379 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9aadf0069b45758a89cfb6a737082d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:11.764078 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:11.764365 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:11.764646 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:11.775311 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:11.776805 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:11.787897 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1445/2924] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:12.193062 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:12.195488 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:12.216060 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee560e-d510-40ec-9704-97733f6eb2f8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:12.226238 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:12.227522 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:12.227852 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:12.228250 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] PATH_INFO: `/v3/projects/78a27dfd812549fe9b114fe82ff3477c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:12.230418 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a27dfd812549fe9b114fe82ff3477c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:12.234091 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:12.298166 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a27dfd812549fe9b114fe82ff3477c', 'request_id': 'req-a1aa4393-67ff-4c18-b093-b5fb994ceba5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.306770 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a27dfd812549fe9b114fe82ff3477c', 'request_id': 'req-a1aa4393-67ff-4c18-b093-b5fb994ceba5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.318198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a27dfd812549fe9b114fe82ff3477c', 'request_id': 'req-a1aa4393-67ff-4c18-b093-b5fb994ceba5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.339373 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] The token cache is being invalidate because project 78a27dfd812549fe9b114fe82ff3477c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:12.339781 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.340839 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.343548 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1480/2925] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:41:12 2022] DELETE /identity/v3/projects/78a27dfd812549fe9b114fe82ff3477c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:12.349153 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:12.360452 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed35c8-d7dd-4886-ab7f-bd72cc289a5d service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:12.429070 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:12.430077 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:12.430421 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:12.430767 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] PATH_INFO: `/v3/users/0f9e428787d646838feb43a0566a0855` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:12.433002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9e428787d646838feb43a0566a0855)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:12.435374 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:12.496253 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:12.498762 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9e428787d646838feb43a0566a0855'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.517522 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9e428787d646838feb43a0566a0855'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.527613 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9e428787d646838feb43a0566a0855'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.528556 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9e428787d646838feb43a0566a0855'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.538372 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9e428787d646838feb43a0566a0855'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:12.545390 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1446/2926] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:41:12 2022] DELETE /identity/v3/users/0f9e428787d646838feb43a0566a0855 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:12.908182 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:12.910783 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:12.925114 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa4393-67ff-4c18-b093-b5fb994ceba5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:12.995018 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:12.996046 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:12.996446 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:12.996828 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] PATH_INFO: `/v3/projects/51c4120ba3314c1a91ededf9b619bea7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:12.998848 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c4120ba3314c1a91ededf9b619bea7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:13.000936 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:13.027816 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:13.056083 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c4120ba3314c1a91ededf9b619bea7', 'request_id': 'req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.064063 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c4120ba3314c1a91ededf9b619bea7', 'request_id': 'req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.070962 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c4120ba3314c1a91ededf9b619bea7', 'request_id': 'req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.087127 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] The token cache is being invalidate because project 51c4120ba3314c1a91ededf9b619bea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:13.087564 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.088359 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.090117 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1481/2927] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:41:12 2022] DELETE /identity/v3/projects/51c4120ba3314c1a91ededf9b619bea7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:41:13.095370 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:13.097901 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:13.121382 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009945a9-afaf-407f-86c1-574f22661f8d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:13.230407 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:13.232446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:13.232952 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:13.233446 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] PATH_INFO: `/v3/users/92b94e20ccae456e99a5c25828e6f849` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:13.235815 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b94e20ccae456e99a5c25828e6f849)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:13.240148 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:13.306377 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b94e20ccae456e99a5c25828e6f849'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.327671 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b94e20ccae456e99a5c25828e6f849'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.337020 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b94e20ccae456e99a5c25828e6f849'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.337995 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b94e20ccae456e99a5c25828e6f849'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.346576 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b94e20ccae456e99a5c25828e6f849'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.353630 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1447/2928] 10.222.0.61 () {58 vars in 1223 bytes} [Fri May 27 03:41:13 2022] DELETE /identity/v3/users/92b94e20ccae456e99a5c25828e6f849 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:13.738386 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:13.740735 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:13.759416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78098ef-a8f5-459e-b7bf-52b95cfcfdcf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:13.831527 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29912cd78134fb2b757b551f0545235', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b90443493d84a01a8c521f600d4b6fc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:13.832416 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:13.832698 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:13.832971 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] PATH_INFO: `/v3/projects/e10801294c43480fb49b368b855a43ed` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:13.834297 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10801294c43480fb49b368b855a43ed)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:13.836305 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:13.894509 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10801294c43480fb49b368b855a43ed', 'request_id': 'req-24220c71-0cbe-4fe7-9765-ca2585df3281'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.902084 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10801294c43480fb49b368b855a43ed', 'request_id': 'req-24220c71-0cbe-4fe7-9765-ca2585df3281'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.909260 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10801294c43480fb49b368b855a43ed', 'request_id': 'req-24220c71-0cbe-4fe7-9765-ca2585df3281'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.924192 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] The token cache is being invalidate because project e10801294c43480fb49b368b855a43ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:13.924503 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.925149 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-24220c71-0cbe-4fe7-9765-ca2585df3281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:13.926813 dv-cinder-828807-4-smb devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1482/2929] 10.222.0.61 () {58 vars in 1232 bytes} [Fri May 27 03:41:13 2022] DELETE /identity/v3/projects/e10801294c43480fb49b368b855a43ed => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:23.350035 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:23.920198 dv-cinder-828807-4-smb devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:03.218230 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:42:03.220079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:03.329026 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c8e54-9544-4530-aa12-2a7fb6c32d3a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:42:03.409384 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2e7c7b4f94b4830adc49cf2f4b84d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1429c6830842569ae0b2cd48e3d563', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:42:03.410079 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:03.410364 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:03.410741 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:03.413298 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:03.435053 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:42:03.437109 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142c4cb-0666-46b1-a264-0b1479fdba3d service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:42:03.450002 dv-cinder-828807-4-smb devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1448/2930] 10.222.0.61 () {60 vars in 1365 bytes} [Fri May 27 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:42:13.444489 dv-cinder-828807-4-smb devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=58 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}